-- Logs begin at Wed 2022-06-29 15:17:15 UTC, end at Wed 2022-06-29 16:34:07 UTC. -- Jun 29 15:55:40.999161 dv-cinder-848147-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 15:55:41.007144 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 15:55:41 2022] *** Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: nodename: dv-cinder-848147-1-iscsi Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: machine: x86_64 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: clock source: unix Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: pcre jit disabled Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: detected number of CPU cores: 4 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: current working directory: / Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: detected binary path: /usr/bin/uwsgi-core Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: your processes number limit is 47680 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: your memory page size is 4096 bytes Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: detected max file descriptor number: 2048 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: lock engine: pthread robust mutexes Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: thunder lock: enabled Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 15:55:41.011855 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 15:55:41.053927 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: Python main interpreter initialized at 0x5565d76049c0 Jun 29 15:55:41.053927 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: python threads support enabled Jun 29 15:55:41.053927 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: your server socket listen backlog is limited to 100 connections Jun 29 15:55:41.053927 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: your mercy for graceful operations on workers is 90 seconds Jun 29 15:55:41.054263 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 15:55:41.054338 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: *** Operational MODE: preforking *** Jun 29 15:55:41.054613 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: *** uWSGI is running in multiple interpreter mode *** Jun 29 15:55:41.054613 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: spawned uWSGI master process (pid: 80235) Jun 29 15:55:41.054807 dv-cinder-848147-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 15:55:41.055902 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: spawned uWSGI worker 1 (pid: 80240, cores: 1) Jun 29 15:55:41.055902 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: spawned uWSGI worker 2 (pid: 80241, cores: 1) Jun 29 15:55:41.055902 dv-cinder-848147-1-iscsi devstack@keystone.service[80235]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 15:55:46.463331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 15:55:46.463331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 29 15:55:46.464133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 15:55:46.464133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 29 15:55:46.464235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 15:55:46.464235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 29 15:55:46.464235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 15:55:46.464235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 29 15:55:46.512868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 15:55:46.513027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 15:55:46.513111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 15:55:46.513220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 15:55:46.513305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] command line args: [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 15:55:46.513414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] command line args: [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 15:55:46.513500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 15:55:46.513669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ================================================================================ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 15:55:46.513751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 15:55:46.513852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ================================================================================ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 15:55:46.513934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_dir = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_dir = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_source = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_source = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] debug = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.514875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] debug = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.515981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_config_append = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_config_append = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_dir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_dir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.516896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.517990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.518859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.519990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.520072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.520260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.520342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] publish_errors = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] publish_errors = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.521990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] standard_threads = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.522864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] standard_threads = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_journal = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_journal = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_json = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_json = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.523953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_stderr = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_stderr = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_syslog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_syslog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 15:55:46.524571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.524648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.524809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.524887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.525867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.526838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.527984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.528952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.529753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.530851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.531980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.532928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.533944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.534859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.535998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.536948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.537944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.538986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.539974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.540940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.541984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.542920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.543874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.544997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.545240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.545480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.545725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.545866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.546991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.547126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.547265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.548900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.549979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.external = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.550952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.password = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.token = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.external = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.551935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.password = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.token = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.552995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.553951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.554916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.555947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.556956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.557995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.558933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.559911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.560926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.561853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.562951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.563926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.564967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.565890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.566991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.567076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.567748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.567858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.568974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.569986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.570926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.571878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.572957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.573996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.574937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.575939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.576994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.577931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.578948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.579908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.580854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.581849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.582798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.583541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.583631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.583774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.583867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.584987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.585949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.586993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.587936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.588963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.589949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.590927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.591887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.592992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.593935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.594965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.595933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.596886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.597893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.598790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.599845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.600969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.601089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.601166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 15:55:46.601336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.601570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.601812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.602040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.602278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.602511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 15:55:46.602680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 15:55:46.632061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.632293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.632392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.632523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.632603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.632751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.640963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.641140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.669692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.669814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.670023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.670104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.813032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.813535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.862303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.862534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.863174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.863500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.927406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.927626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.927718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.927862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.928778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.929080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.929365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.953465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.953717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.953905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.954792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.955023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.955305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.955585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.955894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.965977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.966246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.979382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.979632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.979890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.980825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.981075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.981363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.981644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.981924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.982204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 15:55:46.999294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:46.999494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 15:55:46.999841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:46.999925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.000050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 15:55:47.000232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 15:55:47.000325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.000563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.000735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.000822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.001046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 15:55:47.001129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.001441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.001769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.002094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.002416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.012722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.012995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.013260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.013539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.014182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.014526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.014876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.015233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.021841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.023701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.025114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.025392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.025670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.025950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.026232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.026490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.026753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.027019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.027284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.027553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.027714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.027804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.028130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.028479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.028831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.029182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.029508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.029845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.030197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.030535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.030877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.031212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.054602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.056221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.056497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.058689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.060409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.060765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.061707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.061986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.062374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.066393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.066721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.067235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.069658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.069938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.074368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.074655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.074826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.074917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.075202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.075285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.075477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.075749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.076042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.076310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.080112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.080468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.080820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.081176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.081536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.081883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.082224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.082560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.095151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.095432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.100592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.102200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.102484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.104484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.104786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.107128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.110133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.111109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.111407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.113745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.117177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.117917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.118213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.118502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.118786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.119077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.119360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.120823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.124513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.124818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.125104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.125388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.125681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.125959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.138269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.138552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.138817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.139078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.145097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.145408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.145677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.145940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.146957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.148677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.148960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.152131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.152411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.152690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.153069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.153353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.153865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.155571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.155871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.159207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.159505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.159787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.160094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.160380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.166972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.167251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.167535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.167813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.168109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.169738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.170042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.174171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.174456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.174740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.175024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.175308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.177540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.177851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.188229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.191440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.194772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.195689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.196524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.198143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.198422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.198701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.198969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.202320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.204077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.205718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.205999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.206271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.206354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.207909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.211101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.211399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.211785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.212084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.213686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.215297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.218570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.218875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.219272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.219556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.221070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.221356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.221640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.229236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.229525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.229817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.229900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.230451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.230725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.230993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.231358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.231655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.231955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.232228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.232763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.233039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.233300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.233561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.233821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.237937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 15:55:47.238222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.238500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.238775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.239093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.239986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.240277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.240550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.240823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.241098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.241378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.241641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.241909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.242176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 15:55:47.271643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565d76049c0 pid: 80240 (default app) Jun 29 15:55:47.274972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645aef-954b-4194-9c08-11a894377c65 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:47.275275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645aef-954b-4194-9c08-11a894377c65 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:47.275551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645aef-954b-4194-9c08-11a894377c65 None None] PATH_INFO: `/v3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:47.279724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Jun 29 15:55:47 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:55:47.282508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5565d76049c0 pid: 80241 (default app) Jun 29 15:55:54.883013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:54.883572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:54.883572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:54.884953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:55:54.892370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:54.892788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:54.892930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:54.961611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: INFO dbcounter [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] Registered counter for database keystone Jun 29 15:55:54.982246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG oslo_db.sqlalchemy.engines [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 15:55:54.989309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writer thread running {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 15:55:55.164298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80241) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 15:55:55.164643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80241) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 15:55:55.218463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:55:55.220091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:55:55.339148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1/3] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:55:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 15:55:55.546880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:55:55.617035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: INFO dbcounter [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] Registered counter for database keystone Jun 29 15:55:55.635887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG oslo_db.sqlalchemy.engines [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 15:55:55.641960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writer thread running {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 15:55:55.762289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1fd1f-ec9b-44f1-8330-4bcfe6ee6eab None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:55:55.766522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:55:55.767180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:55.767462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:55.767738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:55.775851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:55:55.827916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 15:55:55.828205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ff8b8-b2de-484c-a9c5-a351416001d5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:55:55.837583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Jun 29 15:55:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 15:55:55.843580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:55:55.858149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa142c8d-7212-4afa-9091-eee60e0ef1f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:55:55.862532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:55:55.864133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:55.864607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:55.864902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] PATH_INFO: `/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:55.869017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] RBAC: Authorizing `identity:get_project(project_id=0320d17cc99a4a6e8e5f8fed868d1937)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:55:55.918864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 15:55:55.919388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3284bb-1228-4205-b665-dae23e0e4b3e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:55:55.923691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 2/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Jun 29 15:55:55 2022] GET /identity/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:55:57.929313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25497bb-d232-42ac-9a7a-e1a78ed45dfe None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:57.929843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25497bb-d232-42ac-9a7a-e1a78ed45dfe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:57.929843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25497bb-d232-42ac-9a7a-e1a78ed45dfe None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:57.933992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 4/6] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:55:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:55:57.939304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:57.939711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:57.939884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:57.958883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:55:57.960421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:55:57.968195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 3/7] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:55:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 15:55:57.990467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25497bb-d232-42ac-9a7a-e1a78ed45dfe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:55:58.002423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25497bb-d232-42ac-9a7a-e1a78ed45dfe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:55:58.007157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:55:58.007779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:58.008094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:58.008372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:58.016175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:55:58.017950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbef5e8-aaa4-4536-ad9d-60df4d2a36e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:55:58.026666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Jun 29 15:55:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 15:55:58.031749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:55:58.040515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f3a4-d7c9-454a-a0c0-f7f4a97097dc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:55:58.044810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:55:58.045659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:55:58.045941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:55:58.046215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:55:58.047586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:55:58.049423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127cfdf-2261-4c23-8b18-74337ea497db admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:55:58.050960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 4/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Jun 29 15:55:58 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:00.127937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9116-c3f5-4465-8761-15920b37cca2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.128446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9116-c3f5-4465-8761-15920b37cca2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.128543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9116-c3f5-4465-8761-15920b37cca2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.130362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:00.135502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.135931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.136101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.147955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c90a3-d5e1-4d8b-b9cf-31b010fb4c04 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.148250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c90a3-d5e1-4d8b-b9cf-31b010fb4c04 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.148531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c90a3-d5e1-4d8b-b9cf-31b010fb4c04 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.149865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 7/11] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:00.153787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:00.154834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.154937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:00.155123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.155404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.194875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80240) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 15:56:00.195291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80240) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 15:56:00.234752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 5/12] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:00.240857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:00.242441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:00.258983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.284290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.341933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 8/13] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:00.363957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f026a-2d4b-4c94-bd1e-04f465429c5d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.364634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.402208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.403007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.403295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.403572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.414694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:00.426488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:00.427379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:00.428357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 6/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:00.433351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.467196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfbf9b-53aa-4a6b-a5f3-e53d3b555ac8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.469510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.505008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.505893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.506175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.506449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.515210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.533560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c99e3-7c6d-4218-8dce-744607965261 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.567055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e74534-7223-419e-8659-92a7588c661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.567717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74534-7223-419e-8659-92a7588c661b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.568041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74534-7223-419e-8659-92a7588c661b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.568324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74534-7223-419e-8659-92a7588c661b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.569079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e74534-7223-419e-8659-92a7588c661b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:00.569387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e74534-7223-419e-8659-92a7588c661b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:00.570788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e74534-7223-419e-8659-92a7588c661b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:00.572132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:00.573625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:00.582480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 7/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:00.588972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e74534-7223-419e-8659-92a7588c661b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.670061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 15:56:00.675285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.677953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.685762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e74534-7223-419e-8659-92a7588c661b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.719639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.720546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.720831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.721102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.722309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:00.723905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:00.725528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 8/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:00.730971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.745109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.774408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242d039-c160-4886-940d-fb665d8f5354 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.807265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.808093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.808377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.808654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.827167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:00.828656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:00.828768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c0f7-4155-4839-9067-6171aa38afb8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:56:00.851529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:00.852563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:00.853366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:56:00.853366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:56:00.853366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:56:00.853366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:00.853366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:00.858723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.864599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.865394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.865679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:00.865955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:00.867138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:00.868624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:00.870218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:00.875816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:00.913785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.956071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:00.957061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe366d-770e-4a82-af15-e94c3e0ef62c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.980026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce22ff-2ab0-4514-9db1-0e573dd763a4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:00.998876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:00.999538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:00.999847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:01.000132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:01.000864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:01.001172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:01.002556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae42197-38e6-4d21-a432-50ce7d1a7792 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:01.014206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:01.014855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:01.015136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:01.015467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:01.016352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.domain.id=default, user.id=06ea7f03390747a9846b3824e80fc6cf) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:01.016663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:01.018099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9c8bc-d0b5-41a1-a5e7-526ca14cd3a9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:01.020825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:01.025358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Jun 29 15:56:00 2022] GET /identity/v3/role_assignments?user.id=06ea7f03390747a9846b3824e80fc6cf&scope.domain.id=default&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:03.330618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eee0b5-50c3-4749-bfe9-166150ceac40 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.331581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eee0b5-50c3-4749-bfe9-166150ceac40 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.332115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eee0b5-50c3-4749-bfe9-166150ceac40 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:03.333988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:03.339130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da009-a602-4d57-93e2-28867786e4cb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.339984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da009-a602-4d57-93e2-28867786e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.340477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da009-a602-4d57-93e2-28867786e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:03.358115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-521da009-a602-4d57-93e2-28867786e4cb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:03.359655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-521da009-a602-4d57-93e2-28867786e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:03.446476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 11/23] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:03.482570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eee0b5-50c3-4749-bfe9-166150ceac40 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:03.499471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ebcd-8fc8-4bdd-ad85-fc84439bd53f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.499752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ebcd-8fc8-4bdd-ad85-fc84439bd53f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.500061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ebcd-8fc8-4bdd-ad85-fc84439bd53f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:03.501565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:03.506899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.507344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.507758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:03.544403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:03.545967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:03.675044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:03.680498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eee0b5-50c3-4749-bfe9-166150ceac40 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:03.703188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:03.716949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:03.723339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:03.733442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:03.734317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.734602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.734876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:03.764805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:03.774145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:03.774998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:03.775720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:03.776306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 13/26] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:03.784356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:03.926060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a5654-2881-43d8-88a7-cbf1b5182f64 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:03.972550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4001-2b8d-4091-b3d7-7d6f797d0a5c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:03.992144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:03.992955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:03.993240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:03.993517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.004815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.006307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f27be5c6-a847-4675-ac47-2472821c9ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:56:04.032602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:04.033458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:04.034247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:56:04.034247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:56:04.034247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:56:04.034247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:04.043220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 14/27] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:04.044129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.044875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.045180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.045457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.046247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:04.046558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.048018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5e39-a61b-41ac-85f8-c0dd3be3a703 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.051571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec4d6-5ce8-4199-935f-4d6431a9d997 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.051878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec4d6-5ce8-4199-935f-4d6431a9d997 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.052163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec4d6-5ce8-4199-935f-4d6431a9d997 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.057875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 15/28] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:04.058660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec4d6-5ce8-4199-935f-4d6431a9d997 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.081065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:04.082913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.083209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.083489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.116159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:04.118668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:04.144299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.158661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.196254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec4d6-5ce8-4199-935f-4d6431a9d997 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.207102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 15/30] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:04.212409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.245812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.246482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.246774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.247051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.247792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:04.248148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.249551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cf6e1-5364-4c8d-9ca4-1d15f975324b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.267792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 16/31] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:04.269246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684d7f-17e9-42a7-ac63-a535f7bc737d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.270070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684d7f-17e9-42a7-ac63-a535f7bc737d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.270353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684d7f-17e9-42a7-ac63-a535f7bc737d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.271710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 17/32] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:04.276117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab684d7f-17e9-42a7-ac63-a535f7bc737d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.341989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17918-643b-4a1f-9485-93a70ea7c0be None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.385675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.386983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.387530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.387842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.389905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.391918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.394565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:04 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:04.395580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.403135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab684d7f-17e9-42a7-ac63-a535f7bc737d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.432265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.446376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.447136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.447422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.447627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.447731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.449287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.450691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae87147-fadd-41f8-9bf4-c40e21a95f98 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.531351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055c96-797e-4ae8-a956-2bdf1d5fbf37 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.567871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.568606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.568893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.569174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.570088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.571736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.578002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 18/34] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jun 29 15:56:04 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:04.579671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.580112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.580490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.619025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:04.620949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:04.773885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 19/35] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:04.775630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 17/36] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:56:04 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:04.775739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.824419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:04.937281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03157e-a9dc-4fe1-9631-e5f24b412b5a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.948043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.974676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:04.981860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:04.983125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.983565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.984020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.985457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:04.987188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed2921-c25c-499e-85e1-ccd2b9fde3c2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:04.989530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 20/37] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:04.990881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b62e-e8a9-4418-8e4e-391c870022a7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:04.992080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b62e-e8a9-4418-8e4e-391c870022a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:04.992207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1d27-cc52-4a15-8954-018bd2a78508 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:04.992617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b62e-e8a9-4418-8e4e-391c870022a7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:04.994742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 21/38] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:04.995575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568b62e-e8a9-4418-8e4e-391c870022a7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:05.039477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:05.040437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.040860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.041272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.042187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:05.043708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdde85-0840-4627-8f37-2d829bb7fec4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:05.067045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 18/39] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jun 29 15:56:04 2022] POST /identity/v3/roles => generated 225 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:56:05.073448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab7d2-0735-4de8-86d6-5bcc6be488e9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.073766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab7d2-0735-4de8-86d6-5bcc6be488e9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.074054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab7d2-0735-4de8-86d6-5bcc6be488e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.095154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-077ab7d2-0735-4de8-86d6-5bcc6be488e9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:05.096786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-077ab7d2-0735-4de8-86d6-5bcc6be488e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:05.124979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568b62e-e8a9-4418-8e4e-391c870022a7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:05.168683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:05.169835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.170125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.170407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] PATH_INFO: `/v3/domains/default/users/06ea7f03390747a9846b3824e80fc6cf/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.172563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=06ea7f03390747a9846b3824e80fc6cf, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:05.174038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:05.180123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 19/40] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:05.182315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce7ba-f190-4302-b2a7-064dacc50b68 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.182833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce7ba-f190-4302-b2a7-064dacc50b68 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.183328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdce7ba-f190-4302-b2a7-064dacc50b68 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.185433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 20/41] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:05.191225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.192538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.193014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.198994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 22/42] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Jun 29 15:56:04 2022] PUT /identity/v3/domains/default/users/06ea7f03390747a9846b3824e80fc6cf/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:05.206044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:05.214265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:05.215516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:05.301738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:05.326548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:05.338123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:05.372404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:05.451136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93eb0-4cd9-4686-aa8e-ec70fc0365f0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:05.451777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7018da-e268-4307-bc7f-f2759e51651e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:05.488079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:05.489057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.489342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.489618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.490455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:05.490790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:05.491142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.491418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.491698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.492274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:05.492493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:05.494055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7a32-e7eb-4be8-9a5a-fe1cc1bb5c1d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:05.494153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 22/44] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:05.499486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:05.509654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jun 29 15:56:05 2022] POST /identity/v3/roles => generated 223 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:05.584413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:05.610603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d2fbc-a5ec-4359-a74c-7af4dbff4860 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:05.647395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:05.648099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:05.648385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:05.648660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:05.649395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:05.650851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e1116-2bfd-40d8-bc32-d105e442f35a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:05.680795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:56:05 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:07.254496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b6e-a8fe-4113-affb-9a34788e4a40 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.254989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b6e-a8fe-4113-affb-9a34788e4a40 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.255060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6b6e-a8fe-4113-affb-9a34788e4a40 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.256480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:07.261563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.261999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.262229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.278972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:07.280176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:07.344751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:07.367421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6b6e-a8fe-4113-affb-9a34788e4a40 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:07.459755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:07.467798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6b6e-a8fe-4113-affb-9a34788e4a40 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:07.501440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:07.502225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.502508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.502783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.513041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:07.520664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:07.521553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:07.522386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:07.529047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:07.585501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:07.626876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc83cb-1cd1-4a85-9e9c-5d32c5c77cf1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:07.658949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90774-084d-43a9-9496-632475350953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:07.659616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90774-084d-43a9-9496-632475350953 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.660504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90774-084d-43a9-9496-632475350953 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.660756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90774-084d-43a9-9496-632475350953 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.661521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90774-084d-43a9-9496-632475350953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:07.661833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90774-084d-43a9-9496-632475350953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:07.663221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90774-084d-43a9-9496-632475350953 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:07.671274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 25/50] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:07.677518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:07.698561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a330-c5a5-4923-b30d-ef7b8e5d01b8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.698858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a330-c5a5-4923-b30d-ef7b8e5d01b8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.699146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4a330-c5a5-4923-b30d-ef7b8e5d01b8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.700873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 26/51] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:07.706160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.706454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.706739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.724504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:07.725720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:07.778320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ff44-bee1-4e39-938d-2ccb64423b25 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:07.819370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:07.820309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.820599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.820860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.822165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:07.823685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:07.825616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 26/52] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:07.831063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:07.858455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:07.897179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 27/53] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:07.921032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:07.933274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6e8f-b13c-4339-b774-f75961f9bc48 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:07.966498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:07.967287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:07.967572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:07.967866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:07.968321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:07.969138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:07.970706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:07.972418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 27/54] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:07.978666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:08.021594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4357121-17a9-4177-9d2c-9330c8ebbb35 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:08.054013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:08.054802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:08.055092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:08.055370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:08.056582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:08.058004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:08.059802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:08.065288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:08.067522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:08.077572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9da9cf-238e-4765-b517-8b7ba79547a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:08.112108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:08.112771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:08.113109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:08.113967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:08.114828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.domain.id=default, user.id=06ea7f03390747a9846b3824e80fc6cf) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:08.115127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:08.116620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae1d66-0542-4136-a6f4-90e393ed9f41 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:08.122331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 28/56] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Jun 29 15:56:07 2022] GET /identity/v3/role_assignments?user.id=06ea7f03390747a9846b3824e80fc6cf&scope.domain.id=default&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:08.170056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265864c0-281d-40cc-8c36-9d566a740920 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:08.188676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:08.205969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:08.206640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:08.206976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:08.207284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:08.208032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:08.209479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f4973-7a2e-407e-8050-9875b7d50f5c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:08.236821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 29/57] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Jun 29 15:56:08 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:56:10.272245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97a46-58f3-4aae-b091-d03cefb08de8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:10.272747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97a46-58f3-4aae-b091-d03cefb08de8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:10.272851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97a46-58f3-4aae-b091-d03cefb08de8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:10.274187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 29/58] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:10.279252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:10.279618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:10.279839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:10.296612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:10.297850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:10.363844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:10.388581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b97a46-58f3-4aae-b091-d03cefb08de8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:10.493945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b97a46-58f3-4aae-b091-d03cefb08de8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:10.526503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:10.527285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:10.527571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:10.527872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:10.529044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:10.530498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eae8d-9f9b-4a5b-9a55-639d2aa8acae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:10.532132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 30/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:10.537863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:10.629493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:10.632446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c076c38-933f-49cb-84f1-baaecad65e7d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:10.666495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:10.667151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:10.667432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:10.667706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:10.668449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:10.669873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06df400-9f3d-47e3-91b8-b3032f6e6953 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:10.694443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 31/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:10 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:13.623862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc408c-1897-4459-a431-d88fdb6a139c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:13.624861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc408c-1897-4459-a431-d88fdb6a139c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:13.625371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc408c-1897-4459-a431-d88fdb6a139c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:13.626933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:13.632257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da89-4c00-4934-b791-4be047e208e6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:13.633052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da89-4c00-4934-b791-4be047e208e6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:13.633523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da89-4c00-4934-b791-4be047e208e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:13.661240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ae97da89-4c00-4934-b791-4be047e208e6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:13.662773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ae97da89-4c00-4934-b791-4be047e208e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:13.754196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 32/63] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:13.794682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc408c-1897-4459-a431-d88fdb6a139c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:13.826464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:13.836641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2987-4556-4bcb-be70-81c1fa797c3b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:13.837248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2987-4556-4bcb-be70-81c1fa797c3b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:13.837721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2987-4556-4bcb-be70-81c1fa797c3b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:13.839288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 33/64] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:13.845138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:13.845674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:13.846164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:13.880894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:13.882424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:13.914791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc408c-1897-4459-a431-d88fdb6a139c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:13.961963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:13.962767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:13.963056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:13.963338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:13.989429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:13.997256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:13.998074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:13.998819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 32/65] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:14.011606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.038800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 34/66] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:14.071047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.100188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.176380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.182886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78d6-eb1f-4316-a228-9e19624af847 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.207376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea0e0-89b4-49ff-b6de-220dc7093498 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.232063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.233165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.233559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.233849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.234611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:14.234926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:14.237192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f1d08-5800-4188-87b1-07e17c7c954b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:14.247659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.248741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.249131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 33/67] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:14.249365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.249803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.250570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e846204-beb8-4e68-bd83-1f3828fd0943 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.250888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e846204-beb8-4e68-bd83-1f3828fd0943 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.251159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e846204-beb8-4e68-bd83-1f3828fd0943 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.252727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 34/68] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:14.257444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e846204-beb8-4e68-bd83-1f3828fd0943 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.264994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-97442d03-4b1b-45b3-8e30-d3c4d05401da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:14.273151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:14.274151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:14.275025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:14.275876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacb31-212f-42c8-a852-4d94e6f2a2af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.275945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacb31-212f-42c8-a852-4d94e6f2a2af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.276191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bacb31-212f-42c8-a852-4d94e6f2a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.293972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-58bacb31-212f-42c8-a852-4d94e6f2a2af None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:14.295148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-58bacb31-212f-42c8-a852-4d94e6f2a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:14.368126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e846204-beb8-4e68-bd83-1f3828fd0943 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.371688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 36/70] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:14.373106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07307f91-0dbc-431c-a49f-dbe5165ff079 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.373399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07307f91-0dbc-431c-a49f-dbe5165ff079 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.373682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07307f91-0dbc-431c-a49f-dbe5165ff079 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.374951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 37/71] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:14.380095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07307f91-0dbc-431c-a49f-dbe5165ff079 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.395403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.409010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.410481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.410768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.411043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.412268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:14.413716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e77da-6ac9-4245-b305-5b39767b36cc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:14.415641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 35/72] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:14.416677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.416966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.417240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.435244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:14.436408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:14.444397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.501266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07307f91-0dbc-431c-a49f-dbe5165ff079 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.507397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 36/73] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:14.508738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.545480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.546157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.546445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.546725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.547489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:14.547806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:14.549227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:14.557830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 38/74] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:14.559859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.627250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.635260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0eba3-9815-4fd3-8a5d-f4bb2c1588ba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.662616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db739c-3194-4b2d-af99-f7c3db5423e3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.669426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.670231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.670514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.670785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.681008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:14.689025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:14.689835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:14.690588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:14.691229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.696401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.697717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.698316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.698602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.698886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.766996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:14.768515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1891-1501-42e5-8ca0-d30882c7d8a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:14.798328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfb851-c5b3-4291-b7a6-1aa77107d846 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.831246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.832658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.832939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.833219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.833341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.843477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:14.851255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:14.852135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 38/76] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:14.853326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.872246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 39/77] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:14.873613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39030e-b46f-4ebe-bafc-d6c8871bba8b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.873903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39030e-b46f-4ebe-bafc-d6c8871bba8b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.874176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39030e-b46f-4ebe-bafc-d6c8871bba8b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:14.875575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 40/78] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:14.876221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39030e-b46f-4ebe-bafc-d6c8871bba8b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:14.920298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:14.960826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc442e-22ac-405c-a37a-ad9e25d01edc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.976876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39030e-b46f-4ebe-bafc-d6c8871bba8b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:14.993816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:14.994679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:14.994961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:14.995238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.008688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.010150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.010684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.011352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.011638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.011956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.012156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 39/79] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.012713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:15.013024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.013106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.014398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.024245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 41/80] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.025372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.055877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.119709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a016c-17e2-4ba9-88f3-6e788047b76e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.125819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ec9d2-7ba2-4468-8327-e628cde52581 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.139847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.153991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.154663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.154948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.155233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.156012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:15.156324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.157704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.159068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.159982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.160263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.160536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.161712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.163136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899b03-acab-48df-afca-4060690ff77d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.164854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 42/81] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.170076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 40/82] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.170076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.170361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.170660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.170948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.187266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:15.188494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:15.254121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 43/83] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:15.254747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.265130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c23a-ce78-49df-8517-5bb7f6212099 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.296410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.298003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.298701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.298988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.299322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.348629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.367738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.368371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd015ad-540b-4ada-bb9b-09b8fcf0e69a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.369252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.401717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.402576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.402855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.403127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.404331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.405805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.407412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 44/84] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.408202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.466992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 41/85] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:15.467842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.500502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.507189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc355cbf-539e-4ee0-b624-df62e0792ca1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.540854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.541505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.541788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.542066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.542902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=06ea7f03390747a9846b3824e80fc6cf) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:15.543227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.544703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.545869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.553628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 45/86] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/role_assignments?user.id=06ea7f03390747a9846b3824e80fc6cf&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.554419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.565950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f24b-f183-4c8b-a0c1-c337bba681c1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.603912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.604823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.605110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.605387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.606729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.608532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.610286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 42/87] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.611111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.681960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281c37-804e-47ae-b713-bffee4041e01 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.721018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912b8f-0656-4ff9-a2af-4490a8192cef None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.725846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.726658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.726945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.727221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.728425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.730286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.732739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 46/88] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.733437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.762786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.763810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.764721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.765158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.765345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.785291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.840762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7745-f0b3-4def-b2ec-f122245dcf71 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:15.841326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.842850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.881282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:15.882163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:15.882445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:15.882725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:15.884168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:15.885666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:15.887398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 47/89] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:15.888179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.962552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 43/90] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:15.963427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:15.985606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:15.992052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86835e-9f3c-4045-9167-7f2804dacac4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.026051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:16.027592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.028281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.028620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.029292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.082331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24243da0-94f4-499f-bd0d-1fa5d4ee7cd1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.106997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.108932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.118610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.119285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.119571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.119863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.120688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.122116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.149443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 44/91] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:15 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:16.150180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:16.226768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:16.237001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 48/92] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:16.238793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:16.275029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66563f-0739-459e-89ac-0bd27222d8b7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.284459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:16.319004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.319866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.320273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.320650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.321651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:16.322071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.323681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.330156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 45/93] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:16 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=b99720dc499444929a34d318a2d6c494 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:16.336347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:16.381596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25337905-85b2-4c67-a957-1299cc853988 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.428790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.429666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.429955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.430229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.431470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.432980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.434896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 49/94] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:16 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:16.440894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:16.489430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41730-bd00-42a9-ae60-37cb1e6e0963 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.532214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:16.538502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.539559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.540019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.540434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] PATH_INFO: `/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.541818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] RBAC: Authorizing `identity:get_project(project_id=d8fb15db556a4036a3ecdc3158db3bfd)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.544163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.546061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 46/95] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:16 2022] GET /identity/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:16.552781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:16.573147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38573-d22c-48aa-9147-edd71d103ce0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.600678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:16.620895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.622003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.622409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.622687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.623690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:16.624342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.626217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61903f-2985-46ed-b92b-6588b5b7bd7a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.634038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 50/96] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:16 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:16.693341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415140e-0d56-42c2-a3f9-d2b084928b0e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:16.733650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:16.734429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:16.734607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:16.734941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:16.735849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=d8fb15db556a4036a3ecdc3158db3bfd, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:16.736178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:16.737741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eefb5-a68b-48a0-bb30-96a5521b105d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:16.744235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 47/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:16 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=d8fb15db556a4036a3ecdc3158db3bfd&role.id=b99720dc499444929a34d318a2d6c494 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:17.995297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca5d2e-211e-466b-ad02-53efc8357ba1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:17.995812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca5d2e-211e-466b-ad02-53efc8357ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:17.995954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca5d2e-211e-466b-ad02-53efc8357ba1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:17.997275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 51/98] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:18.013900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:18.014393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:18.014464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:18.036792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:18.038206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:18.121042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:18.152483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca5d2e-211e-466b-ad02-53efc8357ba1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:18.363452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca5d2e-211e-466b-ad02-53efc8357ba1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:18.439849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:18.450067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:18.451159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:18.451638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:18.452146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:18.476774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:18.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:18.486065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:18.486824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 52/100] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:18.493277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:18.544220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:18.634168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145554ca-5ea1-41a6-b58c-78a5ae7e561a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:18.676656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:18.677327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:18.677610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:18.677887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:18.678638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:18.678945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:18.680363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:18.691868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 49/101] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:18.698221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:18.840782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9b9c-36ba-486b-8b6f-084af747f55d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:18.892695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:18.893502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:18.893785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:18.894092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:18.896811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:18.898285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8985f-ddf0-4fe6-aa25-d8175cbec55c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:18.899945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 53/102] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:18 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:18.908150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.065336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:19.071754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b19b-bcf0-487c-9eec-96b18d1d13b3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.072200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b19b-bcf0-487c-9eec-96b18d1d13b3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.072361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b19b-bcf0-487c-9eec-96b18d1d13b3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.073929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 54/103] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:19.079327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.080186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.080671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.089263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d927-b198-422c-a187-8c3a194d2599 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.111672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:19.114014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:19.201757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:19.203626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.204541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.204825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.205102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.206305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:19.208337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:19.210056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 50/104] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:18 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:19.216381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.216856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 55/105] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:19.261420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.389746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d7aab-6698-46b5-b632-1db429b156cc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.428705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.430106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.430609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.431091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.440120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bd22-2104-49b0-be99-08154f02c752 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.443391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-974d2b98-348c-4788-8598-6b616e73b82b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:19.451660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:19.452769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:19.453675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:19.455697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 56/106] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:19.457677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dcba-6f4d-40fb-b636-d5ad299d5b1a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.458104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dcba-6f4d-40fb-b636-d5ad299d5b1a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.458586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48dcba-6f4d-40fb-b636-d5ad299d5b1a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.460035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 57/107] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:19.470261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.470721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.471134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.491890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.493008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.495911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.495911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/06ea7f03390747a9846b3824e80fc6cf/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.495911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, user_id=06ea7f03390747a9846b3824e80fc6cf, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:19.497718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:19.504006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:19.505551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:19.536534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 51/108] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:19 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/06ea7f03390747a9846b3824e80fc6cf/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:19.537464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.567854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:19.588749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:19.615232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 58/109] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:19.700904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780bb35-79f9-4dbc-ade5-b32db3745b91 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.705560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.739854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.739854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.739854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.739854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.740267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:19.740267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:19.741447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:19.755956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 52/110] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:19.757908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.846600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:19.863432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a35c1b-0cd6-4220-a128-bde4e7c11bb3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.873409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf98d2-f391-4da0-918e-31084e904595 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:19.911502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.912517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.912813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.913291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.916737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:19.918643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:19.928107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 53/111] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:19.930652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:19.948085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:19.948897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:19.949180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:19.949457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:19.972161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:19.980468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:19.981310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:19.982351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 59/112] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:19.989220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.045217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.134228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eef7e-fa3b-4fa7-be76-ee61d8e0686c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.169489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f7380-0d0c-4d85-80d5-b18ee2d01926 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.179283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.180300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.180583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.180884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.182175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:20.183731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4c3cd-89c6-4a14-8533-e230d0d0dfd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:20.185862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 54/113] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:20.187065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b034e-16ed-4103-a382-a7b64c502e6c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.187349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b034e-16ed-4103-a382-a7b64c502e6c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.187624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b034e-16ed-4103-a382-a7b64c502e6c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.188892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 55/114] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:20.189955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d077-79b3-4373-8df9-c55432440c42 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.190241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d077-79b3-4373-8df9-c55432440c42 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.190581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d077-79b3-4373-8df9-c55432440c42 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.192276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 56/115] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:20.196825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7d077-79b3-4373-8df9-c55432440c42 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.211118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.211797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.212142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.212411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.213176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:20.213482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:20.214878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a4869-4c79-478c-a9bd-d1fd14b825b9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:20.220403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.224619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 60/116] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:20.225870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a5b68-2359-4f31-95f4-6101073b4ec4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.226169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a5b68-2359-4f31-95f4-6101073b4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.226449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a5b68-2359-4f31-95f4-6101073b4ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.243400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f33a5b68-2359-4f31-95f4-6101073b4ec4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:20.244623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f33a5b68-2359-4f31-95f4-6101073b4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:20.312459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 61/117] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:20.313928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c08f-bab1-40cc-b8cb-3bf99babdfd5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.314226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c08f-bab1-40cc-b8cb-3bf99babdfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.314321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7d077-79b3-4373-8df9-c55432440c42 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.314500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411c08f-bab1-40cc-b8cb-3bf99babdfd5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.315960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 62/118] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:20.316920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75cc5-4aad-4ea8-8c3e-5284fdb4b450 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.317264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75cc5-4aad-4ea8-8c3e-5284fdb4b450 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.317544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75cc5-4aad-4ea8-8c3e-5284fdb4b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.341018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ace75cc5-4aad-4ea8-8c3e-5284fdb4b450 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:20.342296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ace75cc5-4aad-4ea8-8c3e-5284fdb4b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:20.356884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.358041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.358326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.358604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.360631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, user_id=91e1d83ea82f46f9a9268d80fd86c1c7, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:20.362290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:20.370173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.379076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 57/119] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:20 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:20.380353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.433773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 63/120] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:20.440085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.440085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.440085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.468840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:20.470249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:20.499802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.526224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8657cd-7afb-4b17-a15b-3bf53b0f571a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.562353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 64/121] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:20.563707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.574388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.575295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.575571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.575869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] PATH_INFO: `/v3/users/d07313babf2b446283ebaf4d2311787a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.594030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] RBAC: Authorizing `identity:get_user(user_id=d07313babf2b446283ebaf4d2311787a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:20.596026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:20.598404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 58/122] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:20 2022] GET /identity/v3/users/d07313babf2b446283ebaf4d2311787a => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:20.599356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.676836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.692685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f40f31-13bc-493e-b7dd-f7825f0b4a86 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.714504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369af7-dd96-46a7-9d4e-6dafb57f7efa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.729007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.729746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.730032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.730313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.731610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:20.733496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:20.735299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 65/123] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:20.740940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.757597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.758866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.759446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.760003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.767791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.773881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:20.784231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:20.785982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:20.786871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:20.790177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 59/124] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:20.797198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.858579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd57939-335b-4a59-af7e-a6db497fbb2e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.896120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.896922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.897206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.897484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:20.908456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:20.913457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5c8c-c793-4583-b690-ef5af9e79db5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:20.917219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:20.918061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:20.918831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 66/125] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:20.919487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:20.938875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:20.958307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:20.959287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:20.959791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:20.960303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.026354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af405b7-95b7-4e68-b199-6ab5d67ff1b4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.033022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.038856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.040893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.065057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.065758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.066048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.066329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.067069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.068656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.099678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 67/126] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:56:20 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:21.105045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.165527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 60/127] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:21.167254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.245818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.293702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.299761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a35497-cbc7-46ac-85c4-205417efbe0b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.316396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e770c9-7fea-474f-97c2-ba7ef955d320 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.349357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.350458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.352529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.353023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.354090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:21.356199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.359754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.377249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 61/128] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.380943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.401361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.402385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.402515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.402748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.403599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:21.403944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.405440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.416833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 68/129] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.417656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.513821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b054-bc75-474d-b169-5be0ce8d78b1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.530065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2959fa7-3d66-4a89-9fa6-b8dfffa66294 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.552225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.553675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.554157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.554646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.556440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.558180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.560436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 62/130] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.561740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.562134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.568456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.570164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.570299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.570513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.572203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.573661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.575626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 69/131] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.576515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.599437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.684100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0dce-18eb-4963-955c-624a6816435f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.720962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.722425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.722962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.723428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.730670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.732676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.736868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 63/132] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.739491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.771214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e38b0-a9e3-4d5a-86c6-29ea644d14eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.848086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.851003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.852472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.853006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.855735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=d07313babf2b446283ebaf4d2311787a) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:21.857785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.859441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:21.877815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 70/133] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/role_assignments?user.id=d07313babf2b446283ebaf4d2311787a&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:21.878707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:21.903591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202d3c2-df8c-43ad-a321-b328ebe79e1b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:21.908028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:21.988384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:21.989277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:21.989559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:21.989830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] PATH_INFO: `/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:21.995230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] RBAC: Authorizing `identity:get_project(project_id=d8fb15db556a4036a3ecdc3158db3bfd)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:21.996779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:22.003764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 64/134] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:22.009622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:22.027148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:22.115485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1486798-131a-435a-86e5-4828d5152dbb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.171304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979df58-cccd-43ca-84fe-4a255d9b97cf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.186818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:22.188176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.188626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.189058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.190443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:22.192370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e9eb-033e-494c-af38-32366547b60e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:22.194624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 71/135] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:21 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:22.201395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e419f2-4724-4174-9273-a65a08646167 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.202002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e419f2-4724-4174-9273-a65a08646167 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.202485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e419f2-4724-4174-9273-a65a08646167 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.204362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 72/136] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:22.205466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e419f2-4724-4174-9273-a65a08646167 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:22.221125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:22.222625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.222914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.223190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] PATH_INFO: `/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.227885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8fb15db556a4036a3ecdc3158db3bfd, user_id=91e1d83ea82f46f9a9268d80fd86c1c7, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:22.230573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508eef7-820c-42b4-ad27-813bb0eeb6e8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:22.263113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 65/137] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:22 2022] PUT /identity/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:22.264497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.264853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.265140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.301987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:22.304991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:22.345071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:22.409500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e419f2-4724-4174-9273-a65a08646167 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.440214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:22.449404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:22.450583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.451013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.451431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.453941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, user_id=91e1d83ea82f46f9a9268d80fd86c1c7, role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:22.455591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5413157-c706-447d-a6fd-9efc8e7f2f7b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:22.469158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 66/138] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:22.474081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 73/139] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:22 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/91e1d83ea82f46f9a9268d80fd86c1c7/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:22.529254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:22.547045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968593d8-9911-4816-888f-88cf13276783 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.547481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968593d8-9911-4816-888f-88cf13276783 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.547907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968593d8-9911-4816-888f-88cf13276783 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.549765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 74/140] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:22.556688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.557324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.557984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.577295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:22.578791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:22.708699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b3e7e-96b6-4ce7-96ed-1e14964f74ba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.711158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 75/141] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:22.735798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:22.751052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:22.751888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.752168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.752444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:22.766579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:22.775325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:22.776274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:22.777055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 67/142] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:22.784216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:22.820212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:22.924712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e109cc-5999-4148-8883-8ea63ead979d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.956393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f73d-3e47-4d9e-98f4-352846dcdb3d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:22.972433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:22.980961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:22.982425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:22.982920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:22.983413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.005964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:23.022230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:23.023143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:23.023932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:23.027565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 76/143] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:23.029560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71396f63-1171-463d-a530-9544795ba444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.029801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71396f63-1171-463d-a530-9544795ba444 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.032397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71396f63-1171-463d-a530-9544795ba444 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.032397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71396f63-1171-463d-a530-9544795ba444 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.032397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71396f63-1171-463d-a530-9544795ba444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:23.032397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71396f63-1171-463d-a530-9544795ba444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.033840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.034956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71396f63-1171-463d-a530-9544795ba444 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.051090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 68/144] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:23.056697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71396f63-1171-463d-a530-9544795ba444 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.157806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca41b0f-b477-4111-9f3e-b80829ae4492 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:23.193503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.194550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.195052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.195525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.196509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:23.197028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.198591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.207410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 77/145] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:23.212327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:23.212895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.281747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71396f63-1171-463d-a530-9544795ba444 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:23.286318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:23.373535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cb904-20d8-4c5f-8a0b-8086dcdc024e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:23.407293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.407516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.408220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.408327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.408548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.408656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.408840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] PATH_INFO: `/v3/users/06ea7f03390747a9846b3824e80fc6cf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.408927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.410569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] RBAC: Authorizing `identity:get_user(user_id=06ea7f03390747a9846b3824e80fc6cf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.410681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.412059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.412164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.413797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 78/146] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:23.418249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 69/147] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/users/06ea7f03390747a9846b3824e80fc6cf => generated 247 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:23.420988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.425954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.598121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95dd71-5d33-455a-9b58-948e84f5f655 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:23.601292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d85307-02c7-4ca9-a53e-2ac834adb001 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:23.618832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:23.658636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.659294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.660169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.660448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.665267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:23.665917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:23.666199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:23.666475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:23.689886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:23.738124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.739596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.837772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:23.839245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:23.842922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 79/148] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:23.849123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:23.866275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:23.992398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549646-5904-4bf6-88fd-86f5c8fd6901 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:24.031175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 70/149] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 15:56:24.037372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:24.092549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:24.093512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.093797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.094076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.095329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:24.096836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:24.098575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 80/150] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:23 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:24.117289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:24.133757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:24.266697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303009-7cb1-4f6d-ad9f-ef50912e9272 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:24.323356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:24.324681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.325243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.325726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.327800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:24.328699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:24.330369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:24.332385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 71/151] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:24 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:24.338045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:24.375322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77c4b5-5f4f-4afd-b2d4-89c4b5c57c0b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:24.446169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:24.449017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.449523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.450087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.455124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=06ea7f03390747a9846b3824e80fc6cf) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:24.455670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:24.457373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c80d3-b47e-4588-b2cd-8aeea805c7d7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:24.468629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 81/152] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:24 2022] GET /identity/v3/role_assignments?user.id=06ea7f03390747a9846b3824e80fc6cf&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:24.470493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f081-f692-4f92-b5fe-184ec4043f5e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.471065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f081-f692-4f92-b5fe-184ec4043f5e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.471542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f081-f692-4f92-b5fe-184ec4043f5e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.473565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 82/153] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:24.479883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b85d-9fdb-4cfe-9e01-b53ec4fa19c2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.480486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b85d-9fdb-4cfe-9e01-b53ec4fa19c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.480965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b85d-9fdb-4cfe-9e01-b53ec4fa19c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.501806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d9c1b85d-9fdb-4cfe-9e01-b53ec4fa19c2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:24.504446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d9c1b85d-9fdb-4cfe-9e01-b53ec4fa19c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:24.573651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a689-51f4-4632-bd57-cfeccc4601ea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:24.600504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:24.622130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:24.622801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.623089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.623365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.627385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:24.627385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:24.627385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:24.634036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 72/154] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:24 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=b99720dc499444929a34d318a2d6c494 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:24.662712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 83/155] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:24.705523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:24.721092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8be8-f52a-447e-99d7-131e81155d7c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.721424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8be8-f52a-447e-99d7-131e81155d7c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.721648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8be8-f52a-447e-99d7-131e81155d7c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.724016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 84/156] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:24.730011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506c13-b798-4325-9255-83c471c43d10 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.730326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506c13-b798-4325-9255-83c471c43d10 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.730573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506c13-b798-4325-9255-83c471c43d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.763581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24506c13-b798-4325-9255-83c471c43d10 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:24.764809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24506c13-b798-4325-9255-83c471c43d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:24.863924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d7715-fc06-49c1-8d68-95bc166cb2e6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:24.911421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:24.912603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:24.912901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 85/157] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:24.913562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:24.913851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:24.915115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:24.918563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:24.918563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 73/158] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:24.924390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506c13-b798-4325-9255-83c471c43d10 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:24.927736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:24.941411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.003067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.047288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506c13-b798-4325-9255-83c471c43d10 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.094246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.094922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.095209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.095471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.096403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:25.099070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:25.100612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74dd01-862e-477f-81d3-4963534bcf77 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.131794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 86/159] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:24 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:56:25.152563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.153791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.154291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.154797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.168953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:25.177617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:25.178590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:25.179368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:25.183100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 74/160] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:25.189366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.257252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.303797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112489-19a3-4cc2-9038-80781fc00b6c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.338130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.338802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.339081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.339354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.340138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:25.340447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:25.341826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc314-5d68-4d52-8e27-ad3f7c1c3281 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:25.350516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 87/161] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:25.356036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.427744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efdf48-952b-4fe2-8d64-82db3999a35c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.428251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efdf48-952b-4fe2-8d64-82db3999a35c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.428908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efdf48-952b-4fe2-8d64-82db3999a35c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.431113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 88/162] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:25.436836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69404b-69b8-419c-aa2e-2de341e0fec0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.437212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69404b-69b8-419c-aa2e-2de341e0fec0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.437571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69404b-69b8-419c-aa2e-2de341e0fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.463263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bc69404b-69b8-419c-aa2e-2de341e0fec0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:25.464540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bc69404b-69b8-419c-aa2e-2de341e0fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:25.490288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2276d-fae8-472e-9c5a-85b85feb8272 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.495017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.541147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.542445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.542734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.543006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] PATH_INFO: `/v3/users/d07313babf2b446283ebaf4d2311787a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.544345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] RBAC: Authorizing `identity:get_user(user_id=d07313babf2b446283ebaf4d2311787a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:25.546052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9f4a6-17fe-400e-a427-4d33269cef62 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:25.547802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 75/163] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/users/d07313babf2b446283ebaf4d2311787a => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:25.549269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994c43-5422-406f-bede-35575e3238ef None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.549568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994c43-5422-406f-bede-35575e3238ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.549845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994c43-5422-406f-bede-35575e3238ef None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.551665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 76/164] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:25.553821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994c43-5422-406f-bede-35575e3238ef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.554857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 89/165] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:25.560356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.560811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.561243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.581659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:25.583109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:25.637438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.666870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 90/166] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:25.667544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.711985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994c43-5422-406f-bede-35575e3238ef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.760837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.761707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.761983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.762251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.763460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:25.764959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:25.766722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 77/167] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:25.767538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.808447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bf14c-444b-439e-8746-b28ce50bcb75 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.818789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.860727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.861546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.861828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.862103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.876778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:25.887187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:25.888322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:25.889117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 91/168] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:25.894848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:25.894986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858860c9-69a6-4f43-980e-3f53012d8bb6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:25.933822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:25.935543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:25.935863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:25.936152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:25.943684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:25.950865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:25.961494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:25.963264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 78/169] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:25.965258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.039579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb35c6-34bf-44cd-843e-7d5870c62979 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.108413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.109310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.109590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.109865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/d07313babf2b446283ebaf4d2311787a/roles/7f2f6b274eee47029e0b844a33ed3391` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.112704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, user_id=d07313babf2b446283ebaf4d2311787a, role_id=7f2f6b274eee47029e0b844a33ed3391)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.114168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.139979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 92/170] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:25 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/users/d07313babf2b446283ebaf4d2311787a/roles/7f2f6b274eee47029e0b844a33ed3391 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:26.140870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.149982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:26.155397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438f94-97db-4ea0-9bcb-23cef7d1d4eb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.236732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.237523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.238959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.239257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.240130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:26.240442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.245648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.263091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 79/171] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:26.270037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.355776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:26.359502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd254256-9ec7-432f-aa34-893be62b11d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.436059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a8e2-abbe-40ed-8e17-882ef06ca467 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.442094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.443114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.443625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.444156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.445129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:26.445658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.447264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.467327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 93/172] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:26.476803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.523621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.524868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.525568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.527084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.529192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.531475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.535612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 80/173] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:26 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:26.541625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.596942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:26.676668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52279b-bba6-48a2-808f-7390c5bd4a3d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.722570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836c68-a892-4a92-8b48-3c0fdcf0c9f5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:26.740577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.741461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.741739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.742010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] PATH_INFO: `/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.743209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] RBAC: Authorizing `identity:get_user(user_id=91e1d83ea82f46f9a9268d80fd86c1c7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.744683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.746343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 94/174] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:26 2022] GET /identity/v3/users/91e1d83ea82f46f9a9268d80fd86c1c7 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:26.754036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:26.787689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:26.789065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:26.789593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:26.790041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:26.825754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:26.910410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:26.911925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:26.988445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:27.003567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de41b4-73f3-410d-9839-5fa9cfebd35d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:27.073449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:27.074945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:27.075433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:27.075942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:27.155002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 81/175] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 15:56:27.160676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:27.208879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:27.210240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:27.272214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:27.318031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308384b-33ce-47e2-a160-6c837c94dcc4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:27.374719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:27.387379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:27.388278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:27.388716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:27.389203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:27.391000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:27.393169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:27.396113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 82/176] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:27 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:27.401726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:27.434410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 95/177] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:27.440263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:27.584294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58565763-b753-45c4-94a5-f8fc7fcef3b9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:27.631165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:27.647174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:27.648094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:27.648376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:27.648652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] PATH_INFO: `/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:27.650559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] RBAC: Authorizing `identity:get_project(project_id=d8fb15db556a4036a3ecdc3158db3bfd)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:27.656750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:27.660880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 96/178] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:27 2022] GET /identity/v3/projects/d8fb15db556a4036a3ecdc3158db3bfd => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:27.663878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897eb02-db7e-418f-9fe7-5412240d2c02 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:27.666036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:27.754448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:27.755115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:27.755397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:27.755672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:27.756543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:27.756854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:27.758309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798fcd-5dcb-4eed-846b-6b884a5fe57b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:27.767760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 83/179] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:27 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:27.854051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ff32-83db-4ea7-8a47-4b3d09776884 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:27.914722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:27.915327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:27.915612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:27.915914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:27.916794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=d8fb15db556a4036a3ecdc3158db3bfd, user.id=91e1d83ea82f46f9a9268d80fd86c1c7) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:27.917111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:27.918645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999cca5-8300-4ced-a955-96e6f306c8b9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:27.929798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 97/180] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:27 2022] GET /identity/v3/role_assignments?user.id=91e1d83ea82f46f9a9268d80fd86c1c7&scope.project.id=d8fb15db556a4036a3ecdc3158db3bfd&role.id=b99720dc499444929a34d318a2d6c494 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:28.069022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4490e-7304-4e64-8bef-05e21b045c59 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.069377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4490e-7304-4e64-8bef-05e21b045c59 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.069584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4490e-7304-4e64-8bef-05e21b045c59 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.071243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 84/181] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:28.077328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe775-8bdc-46e3-a79a-fbcb537a1686 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.077328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe775-8bdc-46e3-a79a-fbcb537a1686 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.077328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe775-8bdc-46e3-a79a-fbcb537a1686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.104387 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a53fe775-8bdc-46e3-a79a-fbcb537a1686 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:28.105754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a53fe775-8bdc-46e3-a79a-fbcb537a1686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:28.175963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.189959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 98/182] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:28.214736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4490e-7304-4e64-8bef-05e21b045c59 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.236901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c140-96f5-489d-956d-aca3fa12d62e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.238086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c140-96f5-489d-956d-aca3fa12d62e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.238566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c140-96f5-489d-956d-aca3fa12d62e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.241067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 99/183] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:28.247067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.247625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.248129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.269136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:28.271000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:28.299619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.347637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4490e-7304-4e64-8bef-05e21b045c59 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.358522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 100/184] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:28.386562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.387876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.390908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.391375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.391880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.412420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:28.421968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:28.422821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:28.423600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 85/185] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:28.428452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.511787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20441-8565-4efd-a30c-8adb0d684955 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.538164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.555614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.556729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.557016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.557296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.558324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6385-8866-49e4-9265-48f787d4804a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.569602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b9900167-c2e7-42d9-a9ac-06a7f30433b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:28.580050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:28.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:28.581769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 101/186] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:28.585692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01332-b821-498d-ad34-4f4c981128ce None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.585692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01332-b821-498d-ad34-4f4c981128ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.585692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01332-b821-498d-ad34-4f4c981128ce None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.585692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 102/187] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:28.587323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01332-b821-498d-ad34-4f4c981128ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.598327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.619103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.619780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.620096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.620374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.621129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:28.621436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:28.622861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e12b7-7c40-48e0-9d87-870ed5f72af9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:28.631429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 86/188] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:28.632866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.633342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.633774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.651876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:28.653114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:28.705202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01332-b821-498d-ad34-4f4c981128ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.723698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 87/189] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:28.725108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.746490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.747638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.747979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.748257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.749041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:28.749353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:28.750782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:28.759893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 103/190] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:28.761109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.809745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.828365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fee79-28b5-4b93-9ded-b70f37a2175e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.846543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:28.868139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bd071-81b7-431f-83d4-539d93d48e61 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:28.872682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.873567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.873848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.874175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.890739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:28.892329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:28.894524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 88/191] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:28.896977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:28.904261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:28.905214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:28.905505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:28.905780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:28.907377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:28.909279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:28.916351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 104/192] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:28.916351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.003005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91b364-4104-4a09-b24b-41bb9498d931 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.025018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff69c0-8e53-4348-ab03-977c4c9755e0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.040142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.040618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.041496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.042143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.042509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.043714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.045279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.046879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 89/193] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:29.047610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.067992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.068658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.068935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.069206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.092928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.146396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.147890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17e50-346d-4575-86cd-4d74474e5a57 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.158234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b739f9-6bc8-44ff-9481-2c6e3acfe376 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.192265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.192925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.193209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.193478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.194177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.195622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.227856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 90/194] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:29 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:29.227856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.264980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 105/195] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:29.266294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300daa4-2c99-4ede-b959-27b7539d7e53 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.266578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300daa4-2c99-4ede-b959-27b7539d7e53 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.266863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300daa4-2c99-4ede-b959-27b7539d7e53 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.268532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 106/196] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:29.270998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300daa4-2c99-4ede-b959-27b7539d7e53 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.286781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.338303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.346025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d6e7-8143-45d7-b2fa-970ebef97b10 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.384139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.385133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.385596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.386061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.393655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300daa4-2c99-4ede-b959-27b7539d7e53 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.431076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.432107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.432386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.432662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.434007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.435450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316d454-5eac-4693-aee3-a845b5a4bcd8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.437522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 107/197] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:29.438648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.438932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.439205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.457126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:29.458316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:29.466919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.468462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.539467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 108/198] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:29.540490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.554585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.584411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.590080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 91/199] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:29.591173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.657126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a498ad-a77a-4ee2-8986-f2ee1684751c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.701903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3582-0361-4297-a6f8-a72ccdae91f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:29.704169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.705812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.706157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.706434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.707282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=63851a135e95489982407682279adf7f, user.id=b3861c5eeeea41a0905c3c45077d3db2) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:29.707596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:29.709065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:29.717966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 109/200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/role_assignments?user.id=b3861c5eeeea41a0905c3c45077d3db2&scope.project.id=63851a135e95489982407682279adf7f&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:29.719730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.772482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:29.774117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:29.775793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:29.776527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:29.801577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:29.813619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:29.814555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:29.815321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:29.818548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 92/201] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:29.827845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:29.887902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.927158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:29.939324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bede-255f-462f-a7f8-c8b8fa0b3de2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.008191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.009341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.009614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.010934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.012433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.020139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1ca9b-f5ed-4935-b4d2-2549e7db7d9c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.022749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 110/202] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:30.028731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:30.105161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.105909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.106195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.106464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.107600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:30.107932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.109348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.129911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 93/203] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:30.135535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:30.152617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f4983-df51-451d-b7a2-308554484908 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.188877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.189538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.189819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.190091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.190974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=63851a135e95489982407682279adf7f, user.id=b3861c5eeeea41a0905c3c45077d3db2) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:30.191285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.192771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.198662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 111/204] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:30 2022] GET /identity/v3/role_assignments?user.id=b3861c5eeeea41a0905c3c45077d3db2&scope.project.id=63851a135e95489982407682279adf7f&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:30.316630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d07766-9d88-4d90-8bb3-c59611844390 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.340340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:30.365270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.366076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.366357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.366631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] PATH_INFO: `/v3/users/d07313babf2b446283ebaf4d2311787a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.367864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] RBAC: Authorizing `identity:get_user(user_id=d07313babf2b446283ebaf4d2311787a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.369322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.371259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 94/205] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:30 2022] GET /identity/v3/users/d07313babf2b446283ebaf4d2311787a => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:30.376370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:30.385612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:30.497051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649b53-d373-4b24-91ac-598dba795e4e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.542449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.543162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.543443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.543765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.638273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.640093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.649744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:30.761666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 112/206] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:30.767240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:30.918949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68171cf-6821-43e6-a5a7-1f187513be10 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:30.958248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:30.959123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:30.959410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:30.959685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:30.960933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:30.962389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c86b1-9caa-4dd9-9cb3-572a9ca5d454 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:30.964111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 95/207] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:30 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:30.969854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:31.122677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0e11-9852-4ac7-9f5e-1fba4455e216 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:31.131068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:31.157769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:31.158738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:31.159248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:31.159714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:31.160779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038, user.id=d07313babf2b446283ebaf4d2311787a) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:31.161307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:31.162919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770edf6-cd61-48bf-b946-b51a08c06c59 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:31.169050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 113/208] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:30 2022] GET /identity/v3/role_assignments?user.id=d07313babf2b446283ebaf4d2311787a&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:31.849941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102937b-6820-41dd-9341-d9bc9860ebde None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:31.850313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102937b-6820-41dd-9341-d9bc9860ebde None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:31.850512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102937b-6820-41dd-9341-d9bc9860ebde None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:31.852035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 96/209] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:31.857583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:31.858005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:31.858200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:31.877237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:31.878770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:31.913202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02d34-9d4d-4945-8ab1-62ce7f41fe05 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:31.913499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02d34-9d4d-4945-8ab1-62ce7f41fe05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:31.913797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02d34-9d4d-4945-8ab1-62ce7f41fe05 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:31.915121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 97/210] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:31.920100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:31.920654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:31.920654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:31.940662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:31.943007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:31.955629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 114/211] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:31.979666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.007216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.032058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 98/212] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:32.055808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.092675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.095866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955dca4-e767-4e19-8416-eb3e5a06492d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.132258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.132969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.133249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.133521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.144863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bf68c48f-9195-4f04-8863-1e185bfa91cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:32.152624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:32.153505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:32.154286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 115/213] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:32.155474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f83b8-47dd-4df7-b138-9d9c707b2e69 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.155474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f83b8-47dd-4df7-b138-9d9c707b2e69 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.155720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f83b8-47dd-4df7-b138-9d9c707b2e69 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.157177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 116/214] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:32.161062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f83b8-47dd-4df7-b138-9d9c707b2e69 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.172061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b500cb-8cea-4e8a-b8e4-da928f3d56be None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.207677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.208498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.208783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.209057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.210237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:32.211721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5c6e-f6e6-45da-b3f3-65ce67650e81 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:32.213539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 99/215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:32.214616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.214903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.215178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.231502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:32.233189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:32.276111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f83b8-47dd-4df7-b138-9d9c707b2e69 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.284172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.307303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 100/216] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:32.307956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.329273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.332431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.332917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.334306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:32.335070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:32.337135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:32.349111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 117/217] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:32.349747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.381891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.413655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db08f8c-88b9-43ff-bf72-b99b3e6dfd3c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.448519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.449529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.449891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.450168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.450879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:32.452360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:32.464869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d01d4-a6ac-4e48-8d71-956de4fc4540 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.476476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 101/218] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:32 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:32.476476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.509939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.510820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.511105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.511375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.524768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7b1dcf50-f32f-40cf-a963-db35c35204b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:32.534244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:32.535254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:32.536069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 118/219] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:32.537371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba296-1daa-406d-a8c7-4aa07a204759 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.537371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba296-1daa-406d-a8c7-4aa07a204759 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.537371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba296-1daa-406d-a8c7-4aa07a204759 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.539867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.540000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 119/220] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:32.545929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.546880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.548105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.572375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:32.574135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:32.611717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162907e5-0c83-45de-8b63-93e796ce3f42 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.656250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 120/221] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:32.657125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.658226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.659262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.659418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.659689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] PATH_INFO: `/v3/users/2c6fb144954943998f0e87be74b76d5a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.674577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6fb144954943998f0e87be74b76d5a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:32.676537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:32.678272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 102/222] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/users/2c6fb144954943998f0e87be74b76d5a => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:32.683770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.684240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.792694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871455a9-7bf1-4f98-987c-a1495b336639 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.806567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.814703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f6c3f-4f80-453b-a50f-45d5dd5928a3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:32.838732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.839682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.840602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.841054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.842254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:32.842887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:32.845091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:32.855918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 121/223] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:32.856949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.857306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:32.861596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:32.861596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:32.861596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:32.875086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:32.883632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:32.884548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:32.885339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:32.887336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 103/224] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:32.888371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:32.943220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:32.977407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0929d40-3ba0-4361-bfb9-e55f9382813f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.006848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f66dc8-75aa-4d9b-9df2-fbbb20b3b77e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.014310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.015316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.015316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.015804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.044623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.046414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.046876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.047286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.049598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.052353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.060084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 104/225] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.061062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.096252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.097680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.099605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.177450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624fd4-0f5b-4deb-b0cf-6fc563673441 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.199671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.212660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.213332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.213612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.213883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.214627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:33.214929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.216332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.225329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 105/226] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.226025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.235668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 122/227] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:33.242260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.321166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.348732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437866f-586a-4458-a91d-d9c963ae211a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.371202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833b72-c86a-4499-aed3-a4aac14b4509 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.397322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.399176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.399664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.400414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.402475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.404631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.406781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 106/228] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.411881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.411881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.411881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.411881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.413381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.414370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.415792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.417561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 123/229] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.418685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.467669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.533052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3434d-710f-4791-a6ac-18413b68b581 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.539368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0238-7447-4ba5-9819-4594a1f24084 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.567581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.568601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.568844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.569118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.570323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.571760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.578376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 107/230] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.578376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.582632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.584391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.584674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.584949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/users/b3861c5eeeea41a0905c3c45077d3db2/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.587279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, user_id=b3861c5eeeea41a0905c3c45077d3db2, role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.588879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.611852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 124/231] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:33 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/users/b3861c5eeeea41a0905c3c45077d3db2/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:33.611852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:33.617541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.736022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9de00-9725-4489-a8b4-56d45196ddd5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.738731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:33.789244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.789452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.789676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.789855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.790709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=63851a135e95489982407682279adf7f, user.id=2c6fb144954943998f0e87be74b76d5a) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:33.791853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.792507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.807797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 125/232] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/role_assignments?user.id=2c6fb144954943998f0e87be74b76d5a&scope.project.id=63851a135e95489982407682279adf7f&role.id=b99720dc499444929a34d318a2d6c494 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.819126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15799dc2-b04f-404c-ab0c-204077d55477 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:33.874692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:33.875977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:33.876523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:33.877003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:33.879123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:33.880882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189061f-66c8-44ee-99c6-fddd308a386d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:33.882834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 108/233] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:33 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:33.888965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:34.014587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0bd58-fff0-44c1-ae95-968dd68b3c89 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:34.049175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:34.050961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:34.051433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:34.051987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/users/b3861c5eeeea41a0905c3c45077d3db2/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:34.054149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, user_id=b3861c5eeeea41a0905c3c45077d3db2, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:34.055999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24189-4009-4d36-bcd7-34063f88621c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:34.073441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 126/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:33 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/users/b3861c5eeeea41a0905c3c45077d3db2/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:34.855860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ae9c-5d53-4fa4-a54a-138906edaffa None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:34.856384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ae9c-5d53-4fa4-a54a-138906edaffa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:34.856685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ae9c-5d53-4fa4-a54a-138906edaffa None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:34.858600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 109/235] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:34.864384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:34.864670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:34.864948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:34.880913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36cbd1-d072-4cbb-8666-4b0787e867cb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:34.881190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36cbd1-d072-4cbb-8666-4b0787e867cb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:34.881465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36cbd1-d072-4cbb-8666-4b0787e867cb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:34.882951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 110/236] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:34.885324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:34.886518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:34.905138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:34.905425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:34.905703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:34.920774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:34.924500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:34.926022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:35.003726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 111/237] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:35.032428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 127/238] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:35.050852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.060918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.073788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:35.177105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086ea80-0146-439e-a115-7d12342ac0b8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.232840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.234058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.235189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.237154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:35.238575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:35.240396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:35.243084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 112/239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:35.248822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.281543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dbbe5-9dea-4360-a80c-8b6c12100432 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.349556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.350774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.351248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.351742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:35.372234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:35.379037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:35.382292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:35.383191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:35.383990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:35.386485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 128/240] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:35.392715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.400724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935cc26-3bfc-4025-b32d-37e8678f54bb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.427328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:35.468498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.469180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.469465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.469828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:35.470549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:35.472047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:35.514620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 113/241] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:35 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:35.527580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e14e3-8434-4cb8-bed8-9914f78d3574 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.564822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.566160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.566449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.566723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:35.567533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:35.567858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:35.569247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:35.578987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 129/242] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:35.584661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.722831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d73f1-7b76-45f0-94e8-bbb2422dda51 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.759559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.760476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.760759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.761036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] PATH_INFO: `/v3/users/4e92e5a2da694b6f825293fd0c7b8cff` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:35.775555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] RBAC: Authorizing `identity:get_user(user_id=4e92e5a2da694b6f825293fd0c7b8cff)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:35.777065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:35.778791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 114/243] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:35 2022] GET /identity/v3/users/4e92e5a2da694b6f825293fd0c7b8cff => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:35.784413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:35.870114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:35.893034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406aae10-76b4-42b9-847b-d19235aa526a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:35.929142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:35.929952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:35.930240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:35.930516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.004632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:36.006100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde31211-f233-4eb8-92dd-0d0d6ac2fd27 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:36.105828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.136052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 130/244] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:36.141612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.144689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.162779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952697e-004a-4d55-a051-a98d8c6faadc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.163081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952697e-004a-4d55-a051-a98d8c6faadc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.163340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952697e-004a-4d55-a051-a98d8c6faadc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.164928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 131/245] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:36.170446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b48-b9bb-4439-ad97-f850d2c39c0e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.170732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b48-b9bb-4439-ad97-f850d2c39c0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.171013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b48-b9bb-4439-ad97-f850d2c39c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.191981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bd546b48-b9bb-4439-ad97-f850d2c39c0e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:36.193179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bd546b48-b9bb-4439-ad97-f850d2c39c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:36.278435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 132/246] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:36.281272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6bce-9db2-42a5-a7b7-b57aeefaad12 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.281790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6bce-9db2-42a5-a7b7-b57aeefaad12 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.282267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6bce-9db2-42a5-a7b7-b57aeefaad12 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.283807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 133/247] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:36.289126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531dea-4351-4fbd-81a3-894a2936083e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.290807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.292163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.292450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.316192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:36.317808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:36.329544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:36.330624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.330734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.331466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.332715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:36.334183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:36.336209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 115/248] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:36.336990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.403848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 134/249] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:36.403848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.439092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.444697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.487913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afffe6-8c63-4e51-837a-ea5cf140330f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.510690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd2a5d-4840-4aa6-a7fb-1d8288d9e311 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.525153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:36.525960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.526242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.526520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.538912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:36.547114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:36.548035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:36.548825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 116/250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:36.549591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.552307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:36.553302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.553786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.554279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.555338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, scope.project.id=63851a135e95489982407682279adf7f, user.id=4e92e5a2da694b6f825293fd0c7b8cff) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:36.555877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:36.557540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:36.564013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 135/251] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/role_assignments?user.id=4e92e5a2da694b6f825293fd0c7b8cff&scope.project.id=63851a135e95489982407682279adf7f&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:36.565153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.677207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ad571-ff07-48f5-9ebd-3746041b6b8e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.679349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.681629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705406-cbd0-436f-944c-c64b2fb1c7f6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.717192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:36.717434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:36.718371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.718907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.719396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.720526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:36.721061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:36.722725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:36.726706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:36.727608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:36.728072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:36.728561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:36.733846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 136/252] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:36.743871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:36.745219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:36.750409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:36.751324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:36.752159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 117/253] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:36.759874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:36.962829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057f59-c0de-4ec4-b6cf-b66e325b01c7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:36.975799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016afdb-a0fb-49c4-b835-1b8176c40a74 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.012343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.013188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.013475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.013753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] PATH_INFO: `/v3/users/2c6fb144954943998f0e87be74b76d5a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.020590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] RBAC: Authorizing `identity:get_user(user_id=2c6fb144954943998f0e87be74b76d5a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.024500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.027733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.028665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.029150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.029873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.030104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 137/254] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/users/2c6fb144954943998f0e87be74b76d5a => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:37.031071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:37.031603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.032672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.035055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791de95-ee84-460a-ae10-db50003e5832 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.054931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 118/255] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:37.061446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b0ae-b483-4b0e-ab41-4848fb2ae91f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.062006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b0ae-b483-4b0e-ab41-4848fb2ae91f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.062491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b0ae-b483-4b0e-ab41-4848fb2ae91f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.064194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 119/256] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:37.065121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704b0ae-b483-4b0e-ab41-4848fb2ae91f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.079882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.157470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a7359-c5fb-4f23-83c7-697ac096496d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.159984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.205477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.206393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.206683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.206966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.208231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.209705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dabd2e-aec4-4915-b217-c0ce490ae9d9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.211963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 138/257] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:37.219292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.219554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.220242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.222695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704b0ae-b483-4b0e-ab41-4848fb2ae91f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.264640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:37.265854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:37.270821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.271710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.272023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.272307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.273789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.275249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.281499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 120/258] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:37.282272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.375563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 139/259] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:37.376796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.427882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.472609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf287c-45cb-491f-8ab8-89c33db90eed None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.510139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.527944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.528842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.529123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.529392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/users/2c6fb144954943998f0e87be74b76d5a/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.532162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, user_id=2c6fb144954943998f0e87be74b76d5a, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.534840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.541918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d109-6893-4ca9-8f7b-b78f9189a97e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.563029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 121/260] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:37 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/users/2c6fb144954943998f0e87be74b76d5a/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:37.563651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.621192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.621541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.621829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.622107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.746623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19977-4496-47a0-ac37-ca5313598fd0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.782702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.783511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.783794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.784356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.797427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:37.797927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.799402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:37.807569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:37.808491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:37.809316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 122/261] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:37.817741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:37.873479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.905084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:37.923770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0686e-f5e8-453b-92af-1ad444cd97c2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:37.976544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:37.977227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:37.977570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:37.977846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:37.978650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:37.978960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:37.980377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:37.994393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 123/262] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:38.000082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:38.043958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 140/263] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:38.046230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:38.169970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f269ef1-79ba-41e5-ae79-8361f294e383 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:38.186876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1c758-bc9b-4db8-9d4a-02a3c49f5139 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:38.216267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:38.224193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:38.225327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.225625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.225943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] PATH_INFO: `/v3/users/b3861c5eeeea41a0905c3c45077d3db2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.227155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] RBAC: Authorizing `identity:get_user(user_id=b3861c5eeeea41a0905c3c45077d3db2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:38.229091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:38.231099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 124/264] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:37 2022] GET /identity/v3/users/b3861c5eeeea41a0905c3c45077d3db2 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:38.238228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:38.265486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:38.293066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:38.293940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.294220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.294490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.296604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:38.298048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:38.306732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 141/265] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:38 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:38.307569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:38.349920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872eaf6-73df-474b-90ac-54bb8fbafcc9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:38.413440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:38.414111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.414411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.414672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.497654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:38.558590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f40552-d21e-4d7b-9b3b-3b41bb536f80 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:38.568861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:38.570345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d30d5-ebd7-4a79-8d35-be66b5418705 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:38.641153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:38.641825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.642104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.642379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.643752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=63851a135e95489982407682279adf7f, user.id=b3861c5eeeea41a0905c3c45077d3db2) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:38.644115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:38.645561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:38.662220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 142/266] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:38 2022] GET /identity/v3/role_assignments?user.id=b3861c5eeeea41a0905c3c45077d3db2&scope.project.id=63851a135e95489982407682279adf7f&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:38.773467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 125/267] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:38.779173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:38.839353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f7f2-4c75-447e-9bdc-74e09e669f07 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.839645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f7f2-4c75-447e-9bdc-74e09e669f07 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.839853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f7f2-4c75-447e-9bdc-74e09e669f07 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.841497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 126/268] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:38.846653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:38.846946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:38.847230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:38.864931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:38.866151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:38.908371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:38.976958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412c56-b2d9-4b1d-a106-3c670b04bdd5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.014705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.021792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.022671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.022950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.023223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.023919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 127/269] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:39.024451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.025969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.027940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 143/270] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:38 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:39.033537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.065763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.195155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1c94-a0f7-45f2-bb05-7a690b4838df None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.230715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.239863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.242432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.243038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.244642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.249888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c2fd-e193-46e8-a61e-ec658af6ca60 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.264971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:39.277087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:39.278182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:39.279107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:39.282843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 144/271] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:39.297280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.330545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.330824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.331009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.331291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.332183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=63851a135e95489982407682279adf7f, user.id=b3861c5eeeea41a0905c3c45077d3db2) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:39.332498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.333989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edd6af-e99c-4acd-bd1d-d94be9fe9697 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.341568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 128/272] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/role_assignments?user.id=b3861c5eeeea41a0905c3c45077d3db2&scope.project.id=63851a135e95489982407682279adf7f&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:39.343064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfdfe-5c4f-4739-ad68-38e0044c9172 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.343361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfdfe-5c4f-4739-ad68-38e0044c9172 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.343641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfdfe-5c4f-4739-ad68-38e0044c9172 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.349132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 129/273] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:39.350938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab62e4-98a6-48b9-ab24-58cb3a3b85c4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.351414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab62e4-98a6-48b9-ab24-58cb3a3b85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.351902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab62e4-98a6-48b9-ab24-58cb3a3b85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.374591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-49ab62e4-98a6-48b9-ab24-58cb3a3b85c4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:39.376155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49ab62e4-98a6-48b9-ab24-58cb3a3b85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:39.457188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 130/274] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:39.463856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.492009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2ae-ba31-48f0-86cb-05af96a995c8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.492653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2ae-ba31-48f0-86cb-05af96a995c8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.493007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2ae-ba31-48f0-86cb-05af96a995c8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.494476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 131/275] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:39.502416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.502416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.502416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.511246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944fc56-fbde-448a-bb96-1ee59171dcc6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.520704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:39.522230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:39.553418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.554430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.554927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.555394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.556370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:39.556898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.558383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.569057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 145/276] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:39.570050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.620886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 132/277] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:39.621953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.633936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.704032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1ea16-1c92-4fa3-bb8e-ac2734422f1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.741394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.742311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.742726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.742990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.744156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.744973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcbe6e-5a6b-4e24-b605-133ca4e6f547 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.745600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.747232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 146/278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:39.748145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.773202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.785081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.786955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.787247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.787512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] PATH_INFO: `/v3/users/53b515d8fba143d29787daa1d4adba34` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.801729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] RBAC: Authorizing `identity:get_user(user_id=53b515d8fba143d29787daa1d4adba34)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.803486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.805521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 133/279] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/users/53b515d8fba143d29787daa1d4adba34 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:39.806457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.861237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb684b9-7bb1-42d6-9e20-12c5a63dd2b2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.883794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:39.899259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.900081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.900367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.900644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.912617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:39.915092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec606d53-6009-4a3c-916b-946fc81c54f2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:39.920451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:39.921341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 147/280] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:39.927670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:39.957788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:39.958464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:39.958746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:39.959019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:39.959724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:39.961189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:39.981979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 134/281] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:56:39 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:39.983450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.041406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:40.066306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4e11-2470-494c-b012-188a5ef06685 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.123139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.123813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.124127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.124399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.125366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, user.id=53b515d8fba143d29787daa1d4adba34, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:40.125779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.127316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.128757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bee58-e1b6-4f59-9ba9-56fb70e1bd0a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.133280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 148/282] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/role_assignments?user.id=53b515d8fba143d29787daa1d4adba34&scope.system=all&role.id=b99720dc499444929a34d318a2d6c494 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:40.171971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.172671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.172962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.173240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.174023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:40.174337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.175873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871448-9dfb-4c3a-ace6-13e5cb81a2e3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.185958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 135/283] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:40.191882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.246326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:40.310297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001ae0-797e-4d7f-a9fb-e5df6037bc9e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.337723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172ce8-9fba-4859-a700-953120768068 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.338251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172ce8-9fba-4859-a700-953120768068 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.338329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172ce8-9fba-4859-a700-953120768068 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.339786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 136/284] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:40.345479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.345778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.346423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.351162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.352083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.352374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.352653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] PATH_INFO: `/v3/users/4e92e5a2da694b6f825293fd0c7b8cff` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.353881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] RBAC: Authorizing `identity:get_user(user_id=4e92e5a2da694b6f825293fd0c7b8cff)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.355331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.357504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 149/285] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:40 2022] GET /identity/v3/users/4e92e5a2da694b6f825293fd0c7b8cff => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:40.363072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.367928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:40.370403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:40.451357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 137/286] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:40.476482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.490177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c3a18-fe91-4409-b3bc-c59e1eb99849 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.508441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:40.510311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:40.542720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.544278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.544617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.544896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.547053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.549230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.555925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 150/287] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:40 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:40.559436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.606058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd42750-e9fa-4b01-9cc5-8e5e695d9768 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.659478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.661482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.661767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.662042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.675712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:40.685777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:40.686708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:40.687507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:40.691222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 138/288] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:40.693956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:40.727901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15e3a-aa7c-4da5-913a-ec7ed9af62e1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.809168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.809989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.810268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.810540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/users/4e92e5a2da694b6f825293fd0c7b8cff/roles/7f2f6b274eee47029e0b844a33ed3391` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.812522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, user_id=4e92e5a2da694b6f825293fd0c7b8cff, role_id=7f2f6b274eee47029e0b844a33ed3391)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.813945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.835911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 151/289] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:56:40 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/users/4e92e5a2da694b6f825293fd0c7b8cff/roles/7f2f6b274eee47029e0b844a33ed3391 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:40.836177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:40.856421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211567d-f6a9-4713-b9ac-c767ad969d47 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:40.912026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:40.913137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:40.913623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:40.914095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:40.915073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:40.915588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:40.917311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:40.931383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 139/290] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:40.937264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:41.008226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:41.071301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83bfb0-c6a7-4b04-bf9b-8cc58cdd9a7f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:41.109019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:41.109828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:41.110115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:41.110390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] PATH_INFO: `/v3/users/2c6fb144954943998f0e87be74b76d5a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:41.111588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] RBAC: Authorizing `identity:get_user(user_id=2c6fb144954943998f0e87be74b76d5a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:41.113617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:41.115621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 152/291] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:40 2022] GET /identity/v3/users/2c6fb144954943998f0e87be74b76d5a => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:41.120968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:41.263754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd0bd1-ef42-4b80-bcbf-bbed55708e56 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:41.308965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:41.309621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:41.309902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:41.310172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:41.339431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:41.406653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:41.408058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:41.548284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 140/292] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:41.553758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:41.758594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0d676-a4a5-4d4f-b50c-a3f132713600 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:41.770419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:41.802024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:41.802961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:41.803246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:41.803570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:41.804810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:41.806243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13606ff6-7b49-42fa-b29d-f619df0449b4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:41.808257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 153/293] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:41 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:41.813771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:41.897013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:41.953326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba284-ff2e-4184-85e2-948af6db351b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:41.987108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:41.987764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:41.988077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:41.988358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:41.989185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=63851a135e95489982407682279adf7f, user.id=2c6fb144954943998f0e87be74b76d5a) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:41.989498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:41.990945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100b2a0-834e-40e4-b155-278d1c930e8e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:41.997026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 141/294] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:41 2022] GET /identity/v3/role_assignments?user.id=2c6fb144954943998f0e87be74b76d5a&scope.project.id=63851a135e95489982407682279adf7f&role.id=b99720dc499444929a34d318a2d6c494 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:42.622698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4aef3-7ec7-4146-9faf-beacdbeb1508 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.623201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4aef3-7ec7-4146-9faf-beacdbeb1508 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.623302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4aef3-7ec7-4146-9faf-beacdbeb1508 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.625054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 154/295] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:42.630006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.630425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.630625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.650068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:42.651243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:42.660002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9f60-50e8-4ec1-99c8-a399329b0aa5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.660553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9f60-50e8-4ec1-99c8-a399329b0aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.661028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9f60-50e8-4ec1-99c8-a399329b0aa5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.662866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 155/296] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:42.668448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.668980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.669491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.689335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:42.690978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:42.722541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 142/297] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:42.746735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:42.766717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 156/298] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:42.792123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:42.794630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:42.850062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5899e03-31f2-4cf0-b0be-5c7bb62cd235 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:42.886788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:42.887618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.887933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.888213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.898551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a94cb7d5-02f4-4023-957c-0ac76c513252 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:42.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:42.907251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:42.908478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 143/299] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:42.909860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063c63-e611-41b4-a74c-d0766437d136 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.909936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063c63-e611-41b4-a74c-d0766437d136 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.910173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da063c63-e611-41b4-a74c-d0766437d136 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.915699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 144/300] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:42.915816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b1b0-547d-4e4a-ba76-d72639c10d06 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:42.915919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063c63-e611-41b4-a74c-d0766437d136 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:42.923212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:42.953001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:42.953756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.954075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.954318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.966943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-113498f2-9081-45f8-817c-40efcef7a68c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:42.975314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:42.976241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:42.977038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 157/301] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:42.978561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:42.978561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:42.978561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:42.994928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:42.996175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:43.037506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da063c63-e611-41b4-a74c-d0766437d136 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.044911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.073679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 158/302] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:43.078155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.078992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.079437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.079944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.081229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:43.081533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.084806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.084920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.092691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 145/303] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:43.098437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.194017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.200981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c894-a2c2-4bf7-9e96-58fdce8cd275 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.203295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6bcab-e408-46c5-8259-b134f8e82487 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.235156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.235815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.236125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.236298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.236401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.237164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:43.237267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.237452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.237549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.237720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] PATH_INFO: `/v3/users/ee59328f90414418a3ed4fed22a83ae6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.238833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.246809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 159/304] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:43.247666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.250811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] RBAC: Authorizing `identity:get_user(user_id=ee59328f90414418a3ed4fed22a83ae6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.252419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554b83-1dd1-44c5-8bed-3c35aa981432 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 146/305] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/users/ee59328f90414418a3ed4fed22a83ae6 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46348285-5d59-45ef-b0b2-fdb63a6d7e5a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46348285-5d59-45ef-b0b2-fdb63a6d7e5a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46348285-5d59-45ef-b0b2-fdb63a6d7e5a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 147/306] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:43.258644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46348285-5d59-45ef-b0b2-fdb63a6d7e5a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.287195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.357625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8900417-6cf5-4c0a-8f66-c9cb9ae21a0c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.364605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46348285-5d59-45ef-b0b2-fdb63a6d7e5a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.390125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.390905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.391184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.391454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.392631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.394790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.396425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 160/307] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:43.397182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.401190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.402087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.402371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.402648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] PATH_INFO: `/v3/users/53b515d8fba143d29787daa1d4adba34` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.403840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] RBAC: Authorizing `identity:get_user(user_id=53b515d8fba143d29787daa1d4adba34)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.405301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f1a2-7727-484d-b12f-1edd239d7065 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.406922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 148/308] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/users/53b515d8fba143d29787daa1d4adba34 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:43.408064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.408350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.408622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.425366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.425520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:43.427045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:43.491644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 149/309] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:43.492466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.496825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c917c-8328-4ed4-b0b5-9c4d57bed7fb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.517023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.529860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.530513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.530794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.531068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.531927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, user.id=ee59328f90414418a3ed4fed22a83ae6, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:43.532240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.533655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.539007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 161/310] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/role_assignments?user.id=ee59328f90414418a3ed4fed22a83ae6&scope.system=all&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:43.539751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.603365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6ab9-8c38-4b58-b9f1-d3079482f331 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.641455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.642831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.643285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.643552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] PATH_INFO: `/v3/groups` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.644311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.645863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.652615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.662521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 150/311] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Jun 29 15:56:43 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:43.663375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.672238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a21-d89e-4471-917e-205b11b31db6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.715244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.716160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.716448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.716712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] PATH_INFO: `/v3/system/users/53b515d8fba143d29787daa1d4adba34/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.718946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53b515d8fba143d29787daa1d4adba34, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:43.720384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:43.732910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 162/312] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Jun 29 15:56:43 2022] PUT /identity/v3/system/users/53b515d8fba143d29787daa1d4adba34/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:43.786392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:43.805759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938257-32e0-416b-8046-b0ea9206ae52 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:43.846001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:43.847440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:43.847721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:43.848029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:43.860356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:43.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:43.869243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:43.870026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 151/313] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:43.875457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:43.984158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922c338-21a9-4111-a6d7-e1620f3acca8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:44.020470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:44.021138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:44.021417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:44.021695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:44.022442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:44.022749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:44.024185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:44.033200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 163/314] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:44.039212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:44.146609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2782ca-1082-4ef1-bb13-6fb0ed3ee299 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:44.185086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:44.185974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:44.186261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:44.186533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] PATH_INFO: `/v3/users/4e92e5a2da694b6f825293fd0c7b8cff` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:44.187735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] RBAC: Authorizing `identity:get_user(user_id=4e92e5a2da694b6f825293fd0c7b8cff)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:44.189207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:44.191762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 152/315] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:44 2022] GET /identity/v3/users/4e92e5a2da694b6f825293fd0c7b8cff => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:44.200925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:44.224014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:44.320821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee3241-d568-47a0-a9ca-043ad1db449c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:44.356460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:44.357374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:44.357658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:44.357927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:44.428829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:44.430291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:44.447510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:44.535650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 164/316] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:44.541026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:44.556597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:44.649244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f97f-f6ca-4144-8d48-47d3c9a7c389 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:44.685296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:44.686547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:44.687037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:44.687511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:44.689082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:44.691417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d8840-8b1e-4439-affb-da1fb0f41549 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:44.693397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 153/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:44 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:44.703334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:44.808592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a74ff-1724-40fb-bcda-f43ea12b03fe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:44.830105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:44.850716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:44.851373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:44.851652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:44.851957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:44.852788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, scope.project.id=63851a135e95489982407682279adf7f, user.id=4e92e5a2da694b6f825293fd0c7b8cff) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:44.853102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:44.854516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d057c-4ab5-45c6-8029-6ecc00878fe3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:44.860791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 165/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:56:44 2022] GET /identity/v3/role_assignments?user.id=4e92e5a2da694b6f825293fd0c7b8cff&scope.project.id=63851a135e95489982407682279adf7f&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:45.601363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2b2e-0624-4e51-82e0-74792bccb37a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.601783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2b2e-0624-4e51-82e0-74792bccb37a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.601959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2b2e-0624-4e51-82e0-74792bccb37a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.603419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 154/319] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:45.608593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.608885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.609158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.626166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:45.627335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:45.697780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 166/320] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:45.719359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd2b2e-0624-4e51-82e0-74792bccb37a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:45.804032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:45.825797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd2b2e-0624-4e51-82e0-74792bccb37a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:45.859210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:45.859950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.860231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.860501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.871071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-df4ccbef-51c1-4b7a-8aff-afdd0c38c2c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:45.878685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:45.879582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:45.880963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 155/321] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:45.885717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:45.887925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4404a8-57b5-4948-941b-d9d6c929dcc7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.888220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4404a8-57b5-4948-941b-d9d6c929dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.888501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4404a8-57b5-4948-941b-d9d6c929dcc7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.889861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 156/322] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:45.895014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9353e-377a-4bf9-883c-bb40e4cc1fb0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.895302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9353e-377a-4bf9-883c-bb40e4cc1fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.895580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9353e-377a-4bf9-883c-bb40e4cc1fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.912378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15c9353e-377a-4bf9-883c-bb40e4cc1fb0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:45.913567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15c9353e-377a-4bf9-883c-bb40e4cc1fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:45.980527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 157/323] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:45.981632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e067-326f-4294-a8ca-8a6567e3d7b3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.981921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e067-326f-4294-a8ca-8a6567e3d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.982454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e067-326f-4294-a8ca-8a6567e3d7b3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.983720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 158/324] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:45.986647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c768a29-4ec2-4556-8111-541bcd9da0c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:45.988881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:45.989173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:45.989453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:45.998627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.005467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:46.006651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:46.024829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.025496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.025776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.026049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.026798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:46.027105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.028509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.036950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 167/325] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:46.037728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.071635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.091846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 159/326] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:46.091846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.140073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf56b-b9cf-4007-a415-6055435c896e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.173746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.174560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.174840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.175116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.176313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.177762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.179391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 168/327] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:46.180174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.181629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9697-5cea-4286-9da7-0d8798501fb6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.218178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.219052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.219337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.219613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] PATH_INFO: `/v3/users/ee59328f90414418a3ed4fed22a83ae6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.220831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] RBAC: Authorizing `identity:get_user(user_id=ee59328f90414418a3ed4fed22a83ae6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.222840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.224120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.224510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 160/328] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/users/ee59328f90414418a3ed4fed22a83ae6 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:46.225257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.286598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b81a63-9547-4957-b50e-05c251b32872 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.293560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.319480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.320296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.320573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.320844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.327524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236200eb-24c5-491f-839c-ba30acf18f68 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.331410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:46.340336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:46.341212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:46.342041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 169/329] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:46.342707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.364503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.365169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.365451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.365724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] PATH_INFO: `/v3/groups` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.366413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.367859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.382399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 161/330] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Jun 29 15:56:46 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:56:46.384745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.451558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.455096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17915639-5b38-432a-bbeb-d4432db16a78 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.493691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.494571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.494856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.495137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] PATH_INFO: `/v3/system/users/ee59328f90414418a3ed4fed22a83ae6/roles/7f2f6b274eee47029e0b844a33ed3391` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.496738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ee59328f90414418a3ed4fed22a83ae6, role_id=7f2f6b274eee47029e0b844a33ed3391)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.498174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.506363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 170/331] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Jun 29 15:56:46 2022] PUT /identity/v3/system/users/ee59328f90414418a3ed4fed22a83ae6/roles/7f2f6b274eee47029e0b844a33ed3391 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:46.506710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab0f-a91b-4dab-a108-4b7bf567f659 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.541275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:46.551651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.552886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.553178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.553457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.554268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:46.554577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.556127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.566616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 162/332] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:46.572298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.689498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556d6fd-a07b-4592-901b-88a676a9b164 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.725958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.726792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.727077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.727353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] PATH_INFO: `/v3/users/53b515d8fba143d29787daa1d4adba34` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.728620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] RBAC: Authorizing `identity:get_user(user_id=53b515d8fba143d29787daa1d4adba34)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.730054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb1c40-20f5-423b-9085-e62d1f4b6b7a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.732000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 171/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/users/53b515d8fba143d29787daa1d4adba34 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:46.738538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:46.855381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e44c-19ee-475e-9765-f96e7ac1d958 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:46.895546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:46.896598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:46.897078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:46.897546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:46.898583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] RBAC: Adding query filter params (role.id=b99720dc499444929a34d318a2d6c494, user.id=53b515d8fba143d29787daa1d4adba34, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:46.899101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:46.900907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209db20-25d7-4865-a996-df6eb92358d2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:46.915927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 163/334] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jun 29 15:56:46 2022] GET /identity/v3/role_assignments?user.id=53b515d8fba143d29787daa1d4adba34&scope.system=all&role.id=b99720dc499444929a34d318a2d6c494 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:48.883491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00854c3a-a2f1-45ef-8c3e-54a0a72e63f3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:48.884086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00854c3a-a2f1-45ef-8c3e-54a0a72e63f3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:48.884086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00854c3a-a2f1-45ef-8c3e-54a0a72e63f3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:48.885708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 172/335] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:48.890619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650db9-fd38-4e14-9626-44d8b3d1041e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:48.890909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650db9-fd38-4e14-9626-44d8b3d1041e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:48.891192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650db9-fd38-4e14-9626-44d8b3d1041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:48.891554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034935-f92e-4425-9039-8f7d90c003d9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:48.892350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034935-f92e-4425-9039-8f7d90c003d9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:48.892980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034935-f92e-4425-9039-8f7d90c003d9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:48.894551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 164/336] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:48.899898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:48.900428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:48.900985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:48.916980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-08650db9-fd38-4e14-9626-44d8b3d1041e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:48.918629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-08650db9-fd38-4e14-9626-44d8b3d1041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:48.927413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:48.928950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:48.970531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.011873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.040479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 173/337] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:49.042325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ad60-1f98-4977-b650-d10972f391ec None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.042826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ad60-1f98-4977-b650-d10972f391ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.043468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ad60-1f98-4977-b650-d10972f391ec None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.046215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 174/338] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:49.052205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.052929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.054760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.088045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 165/339] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:49.089994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.108841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:49.110344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:49.254731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 175/340] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:49.255596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.277029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2181-b5e2-430e-9e54-00be08c1f732 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.355025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.355849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.356145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.356421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.384936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:49.394412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:49.395639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:49.396451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:49.402543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 166/341] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:49.403800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.438028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.453764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58277c1-06a2-48e2-a7e8-6e332667bfdd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.479181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.528639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.529382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.529670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.529948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.549637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:49.560567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:49.561456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:49.562257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:49.567645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 176/342] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:49.570008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.572358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcf569-5e13-446f-b156-02f84b267cd6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.632507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.633819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.636089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.636563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.656281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:49.673779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:49.675274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 15:56:49.676105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:49.679477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 167/343] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:49.682020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.735094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723941f1-d88b-4fa9-870d-b8f4efb8f95e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.779366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.780390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.780887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.781350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.782301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:49.782817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:49.784564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:49.798168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 177/344] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:49.800220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.821058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.915349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:49.920415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9f238-5333-45ff-850a-33a749aa28cc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.930520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baada26b-e1e5-4002-bd0f-876184ea0322 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:49.961946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.963071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.963656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.964399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.965472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:49.966013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:49.967697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:49.968145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:49.968602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.969064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.969451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.971461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:49.971461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:49.973154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdbe4c-5b10-48c4-b0f1-b50dc4805d0c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:49.980932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 168/345] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:49.982341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:49.984652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 178/346] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:49.986349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b6c2-5c71-4c10-aad4-a3b653395209 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:49.991992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b6c2-5c71-4c10-aad4-a3b653395209 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:49.994656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b6c2-5c71-4c10-aad4-a3b653395209 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:49.996302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 179/347] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:49.996881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b6c2-5c71-4c10-aad4-a3b653395209 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.091646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.119933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b6c2-5c71-4c10-aad4-a3b653395209 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.126287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a635e9-5bde-4d5f-8b8f-d583ace8a796 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.160072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.160727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.161011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.161305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.164859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.165860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.166334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.166800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.197073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.241968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.242377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.243427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37224-fe09-4767-871e-9bbd9ae9ba19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.244290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.330112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.355084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 169/348] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:50.355908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.360983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 180/349] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:50.363230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ceb2-52c8-43ac-88ef-2762aa188cc3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.363717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ceb2-52c8-43ac-88ef-2762aa188cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.364202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39ceb2-52c8-43ac-88ef-2762aa188cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.381094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1f39ceb2-52c8-43ac-88ef-2762aa188cc3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:50.382596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1f39ceb2-52c8-43ac-88ef-2762aa188cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:50.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.464089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 181/350] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:50.465944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f323-9475-4f1e-8c1b-1f6b53c50fd7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.466417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f323-9475-4f1e-8c1b-1f6b53c50fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.466695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246f323-9475-4f1e-8c1b-1f6b53c50fd7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.469744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 182/351] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:50.469744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246f323-9475-4f1e-8c1b-1f6b53c50fd7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.487083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d6805-b502-4b16-bc5e-2efdbf1489a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.525068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.525943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.526224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.526498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] PATH_INFO: `/v3/users/ee59328f90414418a3ed4fed22a83ae6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.528740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] RBAC: Authorizing `identity:get_user(user_id=ee59328f90414418a3ed4fed22a83ae6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.530961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.533271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 170/352] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/users/ee59328f90414418a3ed4fed22a83ae6 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:50.534609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.603710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246f323-9475-4f1e-8c1b-1f6b53c50fd7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.614245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.644125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.645263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.645544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.645818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.648098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.649372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256de93b-cb76-45a7-9f37-622e5cbd1a32 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.651387 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 183/353] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:50.652599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.652883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.653158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.670930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:50.672145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:50.673350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7133bb-5eab-482e-8bd6-501887112c82 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.705900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.719044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.721863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.721863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.721863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.722145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.723394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.725329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 171/354] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:50.725912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.757096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 184/355] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:50.758220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.859447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086668f-eb68-4678-9754-fd402c19ba2c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.879365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57be7b-0b59-4b0d-8007-c2ffe6420b13 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:50.884062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:50.919147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.919993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.920325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.920609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.921170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:50.921823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:50.922102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:50.922371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:50.923690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] RBAC: Adding query filter params (role.id=7f2f6b274eee47029e0b844a33ed3391, user.id=ee59328f90414418a3ed4fed22a83ae6, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:50.924044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:50.926036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:50.937048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:50.942270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 185/356] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/role_assignments?user.id=ee59328f90414418a3ed4fed22a83ae6&scope.system=all&role.id=7f2f6b274eee47029e0b844a33ed3391 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:50.943008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:50.944153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:50.945019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:50.945819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 172/357] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:50.946461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.021169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.062397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc89c-c114-4735-bc61-9f222ae4002c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.076528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4d5e-e368-4445-973f-09fcb9c59a3e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.119898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.121231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.121731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.122271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.124124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.124992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.125274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.125552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.131259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.132620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.133193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.134077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.135253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 186/358] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.136030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 173/359] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:50 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.136823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.136931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.180638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.260501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8305169-3055-4833-afd4-c9d26cfcd8df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.268560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825925-6d8e-468c-8ebc-291391f8a5d2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.283262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.304582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.305262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.305547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.305823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.306578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:51.306887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.308310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa58c-e6dd-4b7d-a5f3-a482750e13b5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.309757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.310575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.310859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.311137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.319405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 174/360] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.321413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a89c0-0844-43a5-9016-be3a7d77d52d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.321704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a89c0-0844-43a5-9016-be3a7d77d52d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.321979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a89c0-0844-43a5-9016-be3a7d77d52d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.322946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:51.323335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 175/361] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:51.324208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a89c0-0844-43a5-9016-be3a7d77d52d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:51.335488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:51.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 187/362] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:51.338036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.438500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.449934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a89c0-0844-43a5-9016-be3a7d77d52d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.453417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a270b32-9760-4207-b22b-7bb9965d84cd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.488692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.489359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.490291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.490291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.490737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:51.491056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.492550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.495025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.495685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.496134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.496410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.497241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:51.497552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.499052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 176/363] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=b99720dc499444929a34d318a2d6c494 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.499165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd880-0587-4259-be58-998a949a2f9c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.499247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.513926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 188/364] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.513926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.513926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.513926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.533484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:51.535272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:51.577289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.636011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 189/365] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:51.637096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.644850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a032225-7068-44de-b0b6-09874ce87180 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.696045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.696649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.696937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.698208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.755697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.782170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf2fb3-3594-4e5d-838c-f0f9b3a7c826 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:51.794259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.796457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.824957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:51.826079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:51.826364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:51.826904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:51.827667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:51.828243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:51.830320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:51.841030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 190/366] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:51.841924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.852837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:51.928619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 177/367] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:51.930090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:51.972699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704dceb-0ffa-4ff0-bf55-67f503069d03 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.015811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.019498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.019785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.020107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.031211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:52.040817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:52.041751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:52.042558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 191/368] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:52.043213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.051106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.056769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef60f3b-1b8e-480a-93a1-8a67e2c88ed9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.109812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.110481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.110762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.111036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.136211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.186830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6d4b-9b12-4d2c-8b82-4316ba678621 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.204209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.205905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.236292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.238293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.238880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.240053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.243953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.247282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.250932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 192/369] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:52.251984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.328680 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 178/370] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:52.329617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.360791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.395488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.403596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94239a91-9484-42fd-890e-f884149ad30e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.451294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.452519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.452953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.453771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.454672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:52.455428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.457637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.460452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a2eef-5e92-46c9-afd6-47158ecb5a11 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.467907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 193/371] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:52.468878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.504180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.505373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.505755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.506539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.510096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.511104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.514132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 179/372] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:52.514983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.620017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf57e24-4d6c-4701-9407-d0c683ae47f7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.650475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8bcdf-3638-490b-ace3-058b18a4faca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.653092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.658375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.659776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.660112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.660487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.661988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.663229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.667560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 194/373] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:52.671900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.675523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.705850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b51324-e654-4b13-8623-043aa109267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.706860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51324-e654-4b13-8623-043aa109267f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.707312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51324-e654-4b13-8623-043aa109267f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.707885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b51324-e654-4b13-8623-043aa109267f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.789703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39d076-d9be-40b9-bfbc-dbc3c743d8a9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.795050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b51324-e654-4b13-8623-043aa109267f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.797171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b51324-e654-4b13-8623-043aa109267f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.827206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:52.828412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:52.828412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:52.828598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:52.829374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=63851a135e95489982407682279adf7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:52.829691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:52.831791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:52.839900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 195/374] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=63851a135e95489982407682279adf7f&role.id=b99720dc499444929a34d318a2d6c494 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:52.847875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:52.916675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:52.967779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f026e38-fda7-454c-a010-22ec86362e60 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:52.993748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 180/375] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:52.998925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b51324-e654-4b13-8623-043aa109267f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:53.007411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:53.007411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:53.007411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:53.007411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:53.008298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:53.009956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:53.011672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 196/376] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:53.028358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:53.032529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:53.157829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d33f-2021-49fb-9e4e-963d8cdee502 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:53.179578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b51324-e654-4b13-8623-043aa109267f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:53.205159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:53.221520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:53.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:53.222194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:53.222483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:53.222659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:53.222762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:53.222936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:53.223218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] PATH_INFO: `/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:53.223598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=63851a135e95489982407682279adf7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:53.223941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:53.224551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] RBAC: Authorizing `identity:get_project(project_id=0320d17cc99a4a6e8e5f8fed868d1937)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:53.225389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:53.225972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:53.230284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 181/377] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:52 2022] GET /identity/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:53.236621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 197/378] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:53 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=63851a135e95489982407682279adf7f&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:53.237593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:53.331818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:53.352770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc69aa-af23-46a1-ad29-6919ae41e10a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:53.397415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:53.398304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:53.398584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:53.398859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] PATH_INFO: `/v3/groups/0071b2e605924d96b4449405f6a49498` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:53.404559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] RBAC: Authorizing `identity:get_group(group_id=0071b2e605924d96b4449405f6a49498)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:53.406153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae92ae-6768-4326-9118-e6da3841a78e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:53.408307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 182/379] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:53 2022] GET /identity/v3/groups/0071b2e605924d96b4449405f6a49498 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:53.416021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:53.546617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae132b-4baa-4829-b110-f4efe86179d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:53.591360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:53.592439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:53.592946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:53.593428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:53.594467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] RBAC: Adding query filter params (group.id=0071b2e605924d96b4449405f6a49498, role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0320d17cc99a4a6e8e5f8fed868d1937) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:53.594983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:53.596857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7f246-ff7c-4799-87de-bc54704079f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:53.603447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 198/380] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:53 2022] GET /identity/v3/role_assignments?group.id=0071b2e605924d96b4449405f6a49498&scope.project.id=0320d17cc99a4a6e8e5f8fed868d1937&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:54.008669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657d5d-6a3c-41b7-9019-b396ec854e4d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.009196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657d5d-6a3c-41b7-9019-b396ec854e4d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.009196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657d5d-6a3c-41b7-9019-b396ec854e4d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.010559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 183/381] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:54.016032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fed0-b177-463e-9f3e-3afa11eae6d3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.016862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fed0-b177-463e-9f3e-3afa11eae6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.017348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fed0-b177-463e-9f3e-3afa11eae6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.042111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9120fed0-b177-463e-9f3e-3afa11eae6d3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:54.043653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9120fed0-b177-463e-9f3e-3afa11eae6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:54.121691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.140814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 199/382] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:54.147233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300765-ffb5-408e-9275-0113c0e30543 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.147525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300765-ffb5-408e-9275-0113c0e30543 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.147808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b300765-ffb5-408e-9275-0113c0e30543 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.149413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 184/383] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:54.154652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.154949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.155230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.172991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:54.174774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:54.175409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300765-ffb5-408e-9275-0113c0e30543 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.261795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 200/384] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:54.289314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.314619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b300765-ffb5-408e-9275-0113c0e30543 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.355292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.356401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.356840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.357527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.369823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:54.379487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:54.380695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:54.381624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:54.384239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 185/385] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:54.390153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.401417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.407351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1486e9-9730-4fda-91de-110941f1f3ac None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.431331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.449576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.450695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.451153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.451623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.464720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:54.473367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:54.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:54.475061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:54.477289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 201/386] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:54.484760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.516322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f516b-e762-46f3-a5cf-84f9f16fa88f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.553498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.554562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.555083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.555557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.556549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:54.557094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.558683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.568398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 186/387] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:54.574311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.591203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283c6a-8279-477e-bb26-a8cba18ae2eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.628739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.629418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.629700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.629980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.630764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:54.631534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.632549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.643393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 202/388] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:54.648722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.655390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.700298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.703177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebd486-f9d5-4f13-a397-dbf5815f7781 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.742045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.743218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.743692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.744209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.745519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.747110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.749201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 187/389] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:54.754742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.763039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fe1a-edb7-4306-9947-c32a8075b6a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.802042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.802718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.803100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.803475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.804908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.806592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.808646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 203/390] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:54.813653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.869737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1e0f-53b8-47c7-8f92-829b6cf96fba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.907475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.909231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.909678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.910101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.911669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.913323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.915214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 188/391] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:54.923560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:54.927685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dbde-e946-4aa8-a3eb-6bd670e81921 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:54.932162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.939163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:54.965015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:54.965812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:54.966187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:54.966556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:54.967870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:54.969383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:54.976735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 204/392] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:54 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:54.977879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:55.063482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bf1f0-285d-4682-b1cb-bd43971753b4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:55.091439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202335cb-2933-4b48-96fb-cb9c478f5526 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:55.107397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:55.108315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.108596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.108870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/groups/b8cdb5f648904614a4e3022231b473f0/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.111094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, group_id=b8cdb5f648904614a4e3022231b473f0, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:55.112768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc377-dab3-4609-a508-e54207863988 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:55.131853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 189/393] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jun 29 15:56:54 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/groups/b8cdb5f648904614a4e3022231b473f0/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 15:56:55.150225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:55.151173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.151463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.151790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/groups/b8cdb5f648904614a4e3022231b473f0/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.154899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2dd55ff9bbc443bac135a5eb307a038, group_id=b8cdb5f648904614a4e3022231b473f0, role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:55.156489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270137e5-0163-4c7c-ae49-c6d0b1e605f4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:55.191364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 205/394] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jun 29 15:56:54 2022] PUT /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038/groups/b8cdb5f648904614a4e3022231b473f0/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:55.684907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca2e2-41bf-4314-a664-105923b658b3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.685577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca2e2-41bf-4314-a664-105923b658b3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.686068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca2e2-41bf-4314-a664-105923b658b3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.687917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 190/395] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:55.693618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.694156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.694647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.716843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:55.718394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:55.758362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:55.774093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d23f-0127-4c25-a0c7-799efea15791 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.774445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d23f-0127-4c25-a0c7-799efea15791 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.774725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d23f-0127-4c25-a0c7-799efea15791 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.776499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 191/396] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:55.803132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:55.803439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:55.803718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:55.809520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 206/397] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:55.825009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:55.826203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:55.844216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:55.931088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:55.942150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 192/398] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:55.979561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:55.992336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fdf0-1b62-4d69-a8fb-3ab871e811f8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.030763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.032017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.032529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.033028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.044552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:56.054382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:56.055269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:56.056170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:56.058501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 207/399] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:56.064320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.104286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:56.207092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe506-6d0c-431e-896e-bc00e35057bb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.242562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930474e-4dbb-4e20-b8b5-c10abd4106bc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.282571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.284279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.284794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.285290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.286721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:56.287230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.288909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.315691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 208/400] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:56.317209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.318009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.318289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.318605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.320013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.349122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:56.372295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:56.373313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:56.374108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 193/401] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:56.384841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.433357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4a6a-1fe0-4b7b-b462-00fe26dbc4bb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.444566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:56.474473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.475267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.475840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.476128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.477851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.479861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.481889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 209/402] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:56.487846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.557589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:56.595519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99706189-619d-45ee-92c5-e728bc90be46 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.631500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b097bb-09d6-49ae-9f02-e41dbff545cc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.650688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.651918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.652422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.652900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.654290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.655960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234db76-ae21-4cdb-bbf5-9db749a41104 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.657897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 210/403] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:56.659968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb035d-2f28-4c69-a45c-98369e288429 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.660473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb035d-2f28-4c69-a45c-98369e288429 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.660945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb035d-2f28-4c69-a45c-98369e288429 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.662364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 211/404] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:56.666293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.666958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.667236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.667805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.668277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.668593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:56.668900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.669186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.669654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.670284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.679096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 194/405] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:56.683924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.691638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:56.692847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:56.718949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:56.774867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 212/406] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:56:56.775933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.794975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629912fe-1cc0-4286-b547-415c64d0ab96 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.819115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:56.847923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.849830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.850331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.851048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/groups/b8cdb5f648904614a4e3022231b473f0/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.853865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, group_id=b8cdb5f648904614a4e3022231b473f0, role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.856408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.876401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 195/407] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jun 29 15:56:56 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/groups/b8cdb5f648904614a4e3022231b473f0/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:56:56.878151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:56.910367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1357b6-1fa1-4444-9f88-7ca10802b080 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:56.960247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:56.961866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:56.962811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:56.963539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:56.965700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:56.967617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:56.970765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 213/408] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:56.976831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.006950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.009213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973cbb-d4d0-4eea-bd91-b77c158bf792 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.046081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.046893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.047243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.047584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.059760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:57.068355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:57.069253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:57.070038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 196/409] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:56:57.086363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.105344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c20de-dcc4-40f4-bf35-d8f660f25410 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.136626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.149487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.150726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.151209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.151698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.153220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.156503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.157883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 214/410] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:56 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:57.163617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.208873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771ccf1-5d96-44a8-a7d4-01ae0c830b59 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.244578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.245329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.245519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.245786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.246586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:57.246825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.248224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.257306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 197/411] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:57.262876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.265942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.275754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef64a-5bda-4085-a578-8b195fb7c87a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.320254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.321488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.321993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.322461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f/groups/b8cdb5f648904614a4e3022231b473f0/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.324776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] RBAC: Authorizing `identity:create_grant(project_id=63851a135e95489982407682279adf7f, group_id=b8cdb5f648904614a4e3022231b473f0, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.326522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.348756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 215/412] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jun 29 15:56:57 2022] PUT /identity/v3/projects/63851a135e95489982407682279adf7f/groups/b8cdb5f648904614a4e3022231b473f0/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 15:56:57.369035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.372753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba75c6-fa95-4eda-9812-2ea75eac42bd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.410776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.411643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.411950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.412225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] PATH_INFO: `/v3/groups/0071b2e605924d96b4449405f6a49498` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.413409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] RBAC: Authorizing `identity:get_group(group_id=0071b2e605924d96b4449405f6a49498)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.414845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff158-74f2-4ff1-a770-cc6cff7a9dca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.421104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 198/413] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/groups/0071b2e605924d96b4449405f6a49498 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:57.422545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.491907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c396c-3f3d-4821-b442-6d527d12bcc8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.491907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c396c-3f3d-4821-b442-6d527d12bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.491907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c396c-3f3d-4821-b442-6d527d12bcc8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.494098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 199/414] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:56:57.498697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.499007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.499339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.518368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:57.519415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:57.563801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e2fc-3389-4b06-a08f-fd736e7ab09d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.595374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 200/415] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:57.602614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.603749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.604253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.604723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] PATH_INFO: `/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.606208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] RBAC: Authorizing `identity:get_project(project_id=0320d17cc99a4a6e8e5f8fed868d1937)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.608146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.610375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 216/416] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:57.616536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.625151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.648644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.720066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.726247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811e141-af85-401e-b2bb-1a8e8d665012 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.737420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7ebae-9750-400c-a56e-18fdd1dd0a28 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.762487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.763701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.764200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.764665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] PATH_INFO: `/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937/groups/0071b2e605924d96b4449405f6a49498/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.766834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] RBAC: Authorizing `identity:create_grant(project_id=0320d17cc99a4a6e8e5f8fed868d1937, group_id=0071b2e605924d96b4449405f6a49498, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.769129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30abdf-a5d8-4db5-9431-90a0fe65900d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.775056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.783946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.783946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.783946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.787582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:57.796612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:57.797503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:56:57.798768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 217/417] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:57.805813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.806543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 201/418] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Jun 29 15:56:57 2022] PUT /identity/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937/groups/0071b2e605924d96b4449405f6a49498/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 15:56:57.899061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:57.920413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92bf3b-c3e1-4b62-a611-2eb4a3fddaaf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:57.957991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:57.958735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.959022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.959352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.960156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:57.960471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:57.961882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:57.967648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4200df-cbdc-4e51-bed3-c49cda1ef3e2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.967985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4200df-cbdc-4e51-bed3-c49cda1ef3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.968268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4200df-cbdc-4e51-bed3-c49cda1ef3e2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.970026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 202/419] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:57.972719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 218/420] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:57.975466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:57.975756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:57.976081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:57.978136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:57.994129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:57.995347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:58.093831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a469-047c-4925-811d-a8b596cdd62f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.119515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 203/421] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:58.132777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.133516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.133924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.134277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.144543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.148213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:58.207657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:58.209202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:58.298166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:58.322793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 219/422] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:58.328469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.347457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d8deb-c523-4da9-8196-0c342ce2fb68 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.392213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:58.443172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1272d-95d7-4b15-9759-aa1e796edf3e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.477951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.478709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.478959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.479228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.487894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.488961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.489399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.489817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.491412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:58.494098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:58.502798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 220/423] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:58.503880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.507167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:58.523528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:58.524714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:58.525690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 204/424] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:58.530774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.612424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e311578-9b79-41c7-b517-ce176a12b7d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.636217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:58.648735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.649916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.650520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.650941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.652509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:58.654096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:58.656481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 221/425] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:58.663032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.726509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849fa14-08f9-4b21-b0ec-44f299a1e188 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.772617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536434c6-f516-4b95-988a-f4e34923a8c5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:58.811432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.812654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.813413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.814164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:58.815024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:58.815446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.816478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:58.816921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:58.817338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:58.817787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:58.818679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:58.820188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:58.821716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:58.822338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:58.840534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 222/426] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=b99720dc499444929a34d318a2d6c494 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:58.844966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 205/427] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:56:58.851010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:58.912229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:58.976151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64632b-04e4-47e7-8ab1-588fc0405c2a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.014818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.015733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.016224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.016644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.093770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:59.095228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:59.144255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:59.199371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 223/428] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:56:59.204661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:59.223627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:59.330506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fc51-98ae-40f7-89b4-ac03a5ce9361 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.371492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.372324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.372606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.372876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] PATH_INFO: `/v3/projects/e2dd55ff9bbc443bac135a5eb307a038` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.374082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] RBAC: Authorizing `identity:get_project(project_id=e2dd55ff9bbc443bac135a5eb307a038)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:59.375534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9dfc-7041-4cd9-9e0c-f6d96ace1707 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:59.377288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 206/429] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:56:59 2022] GET /identity/v3/projects/e2dd55ff9bbc443bac135a5eb307a038 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:59.382814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:59.475984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a3e1-9346-4ac3-a23b-ed4ec24ea368 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.476607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a3e1-9346-4ac3-a23b-ed4ec24ea368 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.477100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a3e1-9346-4ac3-a23b-ed4ec24ea368 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.478651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 207/430] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:56:59.484429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cc12-8844-485a-b307-809bee616d05 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.484709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cc12-8844-485a-b307-809bee616d05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.484979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cc12-8844-485a-b307-809bee616d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.491858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398c958-26f3-4d45-a556-4acb0e59e705 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.506556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9492cc12-8844-485a-b307-809bee616d05 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:56:59.507794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9492cc12-8844-485a-b307-809bee616d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:56:59.542672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.543862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.544151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.544424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.546124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:59.547705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:59.550285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 224/431] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:56:59 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:59.559066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:59.575136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:59.608851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 208/432] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:56:59.626723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492cc12-8844-485a-b307-809bee616d05 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:59.644225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:59.703613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0242-06c2-4466-8388-9e00c0f72544 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.743668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492cc12-8844-485a-b307-809bee616d05 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.759534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.760244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.760524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.760797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.763479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=e2dd55ff9bbc443bac135a5eb307a038) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:59.763479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:59.763479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:56:59.774958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 225/433] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:56:59 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=e2dd55ff9bbc443bac135a5eb307a038&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:56:59.802965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.804213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.804817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.805294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.820827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:56:59.829600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:56:59.831158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:56:59.832432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:56:59.839495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 209/434] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:56:59.841236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:56:59.927873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:56:59.956461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ffa47-e3fa-4ec1-8bec-86d9ab61b7d3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:56:59.991968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:56:59.992981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:56:59.993482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:56:59.993950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:56:59.994903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:56:59.995401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:56:59.996987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760984da-6feb-4fa1-9b28-a91e784f8e35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.006783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 226/435] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:56:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:00.012846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.100386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.117005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a13af-a68b-48b1-b63e-2d89f86d9399 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.117296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a13af-a68b-48b1-b63e-2d89f86d9399 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.117573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a13af-a68b-48b1-b63e-2d89f86d9399 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.119200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 227/436] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:00.124253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.124544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.124827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.149841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:00.151385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e59a7-12b9-4c3b-bffd-72ff082cea17 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.151786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:00.199558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.200107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.200387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.200658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.249441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 228/437] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:00.273271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.280054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.281529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115a6e-fb93-4298-927b-254fde9156bb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.340237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.348727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.374420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31085d31-b7b1-400f-8023-147c47b6cce1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.384013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 210/438] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:00.385312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c90e3-81ee-4a92-bb62-81453d5f4028 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.385600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c90e3-81ee-4a92-bb62-81453d5f4028 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.385877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c90e3-81ee-4a92-bb62-81453d5f4028 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.387128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 211/439] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:00.389259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c90e3-81ee-4a92-bb62-81453d5f4028 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.413314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.414108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.414389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.414661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.424748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aa65b966-8b23-465b-a458-4005129a1d71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:00.432830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:00.433796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:00.434783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 229/440] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:00.435575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.435575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.435689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.451143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:00.452278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:00.492098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c90e3-81ee-4a92-bb62-81453d5f4028 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.516857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 230/441] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:00.517665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.530340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.531197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.531479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.531755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.532975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.535049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.536749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 212/442] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:00.540682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.573392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.582541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.625860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cda7d-e9c2-4c7a-8b9b-3b4018e784db None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.638771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c4711-ec90-4c94-b00b-f3e2bddc01d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.659601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.660288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.660563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.660834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.661630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:00.662204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.663560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.671432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 231/443] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:00.671805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.672227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.672623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.672908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.673185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.683962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:00.692201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:00.693095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:00.693897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 213/444] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:00.694540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.772363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0094-0d0e-4ebf-b53d-67ba706b1d3a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.785350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.789693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.793087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52429ff1-8c40-4377-80ab-6a44252b7011 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.808421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.809273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.809555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.809830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.811003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.812461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.819524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 232/445] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:00.819524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.827924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.828571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.828857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.829137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.897527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.898963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.915195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b156c02-5aa8-4752-a346-efa43f558ddc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:00.947632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:00.948305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:00.948592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:00.948863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:00.949594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:00.949903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:00.951235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:00.959093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 233/446] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:00.959885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:00.988660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:00.998145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 214/447] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:00.998969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.012756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.069342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376609b-8563-452b-bee7-6e67371803d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.099601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb8ef-b7ee-4c6a-b051-4aa42a2b054f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.102743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.103396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.103678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.103986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.104840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=63851a135e95489982407682279adf7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:01.105157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.106607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.120022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 234/448] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=63851a135e95489982407682279adf7f&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:01.121249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.135007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.135552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.135865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.136145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.207871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.218893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.220432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.235518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd543a-520f-4ef0-bf12-f6ca6da7de84 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.250591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.278193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.279531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.279531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.279720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] PATH_INFO: `/v3/projects/63851a135e95489982407682279adf7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.280841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] RBAC: Authorizing `identity:get_project(project_id=63851a135e95489982407682279adf7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.282265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.284602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 235/449] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/projects/63851a135e95489982407682279adf7f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:01.289452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.340160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 215/450] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:01.346287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.391662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d29a8-3695-4cd5-ac46-6db9ddabcc9f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.423619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.425070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.425345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.425612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] PATH_INFO: `/v3/groups/b8cdb5f648904614a4e3022231b473f0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.426789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] RBAC: Authorizing `identity:get_group(group_id=b8cdb5f648904614a4e3022231b473f0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.428266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.429873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 236/451] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/groups/b8cdb5f648904614a4e3022231b473f0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:01.435482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.435611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.442831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298c01-e591-49e2-a383-03fb5fbc4a2a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.477202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487433f-2211-461d-bc69-848460c62908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.478062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487433f-2211-461d-bc69-848460c62908 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.478342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487433f-2211-461d-bc69-848460c62908 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.478615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487433f-2211-461d-bc69-848460c62908 None admin] PATH_INFO: `/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.479841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487433f-2211-461d-bc69-848460c62908 None admin] RBAC: Authorizing `identity:get_project(project_id=0320d17cc99a4a6e8e5f8fed868d1937)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.481306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487433f-2211-461d-bc69-848460c62908 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.482879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.483243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 216/452] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/projects/0320d17cc99a4a6e8e5f8fed868d1937 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:01.489193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487433f-2211-461d-bc69-848460c62908 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.532862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682de1-ffc9-42eb-8621-b05eacd7b360 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.566141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.566788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.567065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.567337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.568184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] RBAC: Adding query filter params (group.id=b8cdb5f648904614a4e3022231b473f0, role.id=b99720dc499444929a34d318a2d6c494, scope.project.id=63851a135e95489982407682279adf7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:01.568494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.569902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.583096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 237/453] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/role_assignments?group.id=b8cdb5f648904614a4e3022231b473f0&scope.project.id=63851a135e95489982407682279adf7f&role.id=b99720dc499444929a34d318a2d6c494 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:01.593848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487433f-2211-461d-bc69-848460c62908 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.630978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.631888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.632169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.632440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] PATH_INFO: `/v3/groups/0071b2e605924d96b4449405f6a49498` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.633676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] RBAC: Authorizing `identity:get_group(group_id=0071b2e605924d96b4449405f6a49498)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.635137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b34190-adc5-41d4-8f8b-8082c62a1bd5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.636814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 217/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/groups/0071b2e605924d96b4449405f6a49498 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:01.642960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:01.750013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90da4b-cfa7-4808-8947-c25a7a47f3db None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:01.760089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:01.781324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:01.781975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:01.782256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:01.782534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:01.783939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] RBAC: Adding query filter params (group.id=0071b2e605924d96b4449405f6a49498, role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0320d17cc99a4a6e8e5f8fed868d1937) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:01.784277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:01.785715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba625437-8725-47b0-9292-5bb795ede498 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:01.791914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 238/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Jun 29 15:57:01 2022] GET /identity/v3/role_assignments?group.id=0071b2e605924d96b4449405f6a49498&scope.project.id=0320d17cc99a4a6e8e5f8fed868d1937&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:04.475887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d508a-67f3-48e9-b27d-f3060ab26bdd None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.476382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d508a-67f3-48e9-b27d-f3060ab26bdd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.476382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d508a-67f3-48e9-b27d-f3060ab26bdd None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.477995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 218/456] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:04.483265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.484113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.484607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.512803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:04.514361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:04.551980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987078-9593-4fb2-ab29-a1d1e167f7f8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.552601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987078-9593-4fb2-ab29-a1d1e167f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.553084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77987078-9593-4fb2-ab29-a1d1e167f7f8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.554897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 219/457] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:04.560067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.560604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.561084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.587945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:04.589670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:04.624319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 239/458] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:04.636607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:04.665477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:04.683281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 220/459] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:04.724260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:04.841497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e36b-1ef2-4347-a290-e6777ae70e72 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:04.847112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f83eba-7e84-4856-a86f-f1e5fa1290c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:04.858727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:04.878175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:04.879201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.879631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.880108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.890866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:04.893105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:04.912121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:04.913225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:04.914282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:04.914282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:04.914282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:04.914282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:04.916165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 221/460] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:04.921793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:04.940195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:04.953199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:04.954014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:04.954295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:04.954573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:04.968609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:04.970043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-147c9665-7230-4b31-99d2-dd2fa1c5dcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:05.001056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:05.002166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:05.003017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:05.003017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:05.003017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.003017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:05.003615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 240/461] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:05.005310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b88b2-3c4a-4dfb-b3c6-5f4b70e13ae3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.005739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b88b2-3c4a-4dfb-b3c6-5f4b70e13ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.006177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b88b2-3c4a-4dfb-b3c6-5f4b70e13ae3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.007581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 241/462] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:05.012308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b88b2-3c4a-4dfb-b3c6-5f4b70e13ae3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.028371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a96f9-6dcc-4d96-8802-3e106436c264 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.068228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.069270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.069777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.070266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.071129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:05.071597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.073021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3ff44-9d31-4cab-9306-a994da6750cf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.091771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 222/463] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:05.091771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556f89-e7d1-416f-86dc-9e3363efcb67 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.091771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556f89-e7d1-416f-86dc-9e3363efcb67 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.091771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556f89-e7d1-416f-86dc-9e3363efcb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.106822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-69556f89-e7d1-416f-86dc-9e3363efcb67 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:05.108260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-69556f89-e7d1-416f-86dc-9e3363efcb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:05.140497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b88b2-3c4a-4dfb-b3c6-5f4b70e13ae3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.175500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.176331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.176624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.176903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.177628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:05.177968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.179334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569a3d2-42c9-411a-81ec-afdbd1da41c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.183019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 223/464] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:05.184544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044fb-bff6-447f-8fa4-fe3e67e41fff None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.185021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044fb-bff6-447f-8fa4-fe3e67e41fff None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.185474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4044fb-bff6-447f-8fa4-fe3e67e41fff None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.192126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 224/465] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:05.193061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4044fb-bff6-447f-8fa4-fe3e67e41fff None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.196726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 242/466] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:05.198065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.198359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.198643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.213492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.217331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:05.218542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:05.233397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.290922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 243/467] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:05.291793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.313871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4044fb-bff6-447f-8fa4-fe3e67e41fff None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.353839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.354472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.354756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.355036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.355743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.357548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.380599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 225/468] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:05.381419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.406761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20bb1-1b44-42a7-b4aa-e8970c1fb707 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.448614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.449411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.449765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.450290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.451082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.452830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.466389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.480529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 244/469] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:05.482636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.488782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.529899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bd9b-5e4a-46a6-8795-590cd750c7d0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.575067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.576270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.576755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.577460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.591179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.593092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:05.616238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:05.617133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:05.618014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:05.618014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:05.618014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.618014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:05.620477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 226/470] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:05.621253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca167-e355-4ca4-ac20-ff84f1d64510 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.633022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.679742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.680640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.680929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.681411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.696542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.698645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:05.722466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:05.723551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:05.724519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:05.724519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:05.724519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:05.724519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:05.724519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 245/471] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:05.731275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.763623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59711f92-fe66-495e-8707-b38aaedc1417 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.776097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.801986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:05.811907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.812548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.812832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.813110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.813846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:05.814142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.816151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.830473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 227/472] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:05.836286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.863614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b55b45-7de1-4cbb-ac40-50ee17f35de3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:05.898742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:05.899319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.899601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.899964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.900699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:05.901005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:05.902373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70fac0-571d-4e45-96ff-7117870b62c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:05.919445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 246/473] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:05.920931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa877-9a26-49f3-ab99-f910802f8f00 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:05.921213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa877-9a26-49f3-ab99-f910802f8f00 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:05.921488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa877-9a26-49f3-ab99-f910802f8f00 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:05.922721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 247/474] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:05.928048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa877-9a26-49f3-ab99-f910802f8f00 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:05.970647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732247-97f3-474d-bee7-6c213bfd8640 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:06.009659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:06.010325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.010604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.010876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.011584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:06.013043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eccb8-8368-405c-995a-ee2aba00a08a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:06.039663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 228/475] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:57:06.041103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.041373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.041644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.077184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:06.078414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:06.084483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa877-9a26-49f3-ab99-f910802f8f00 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:06.114186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:06.126902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:06.155638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:06.156291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.156568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.156850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.157557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:06.159744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:06.189482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 248/476] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:05 2022] POST /identity/v3/users => generated 249 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:06.214704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 229/477] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:06.239451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:06.356427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a7c32-3f17-41f6-b69f-ec9b3419685f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:06.399193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:06.399903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.400186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.400455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.401208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:06.402576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:06.410259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 15:57:06.410259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 15:57:06.410259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [parameters: {'id': 'adab28a861e64bad99dcc384f41d46ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 15:57:06.410259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:06.426300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:06.427207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 15:57:06.428143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 15:57:06.428993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:06.429878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:06.430699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'id': 'adab28a861e64bad99dcc384f41d46ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:06.431500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 15:57:06.434135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:06.436142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 249/478] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jun 29 15:57:06 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:06.436278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:06.545382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ca87-1243-4fc0-aa74-1d26aaf2ff58 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:06.581773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:06.582571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.582853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.583122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.593597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3e076da7-99d0-4417-b32d-28e9a27c7733 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:06.601668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:06.602545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 15:57:06.603356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:06.607741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 230/479] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:06.609065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:06.661155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:06.747988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4880e2-54ab-4495-8ebb-386f3e72b63c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:06.790391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:06.791055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:06.791333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:06.791603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:06.792391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:06.792778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:06.794150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93077a5b-1f04-4fe1-b541-6151aeead8aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:06.807162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 250/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:08.038995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff857-45d8-4cad-9de1-8756ee974972 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.040052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff857-45d8-4cad-9de1-8756ee974972 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.040535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff857-45d8-4cad-9de1-8756ee974972 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.042343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 231/481] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:08.047177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c14db-6de4-404e-8205-c5410bddfdd0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.047993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c14db-6de4-404e-8205-c5410bddfdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.048483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c14db-6de4-404e-8205-c5410bddfdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.072569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-751c14db-6de4-404e-8205-c5410bddfdd0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:08.074094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-751c14db-6de4-404e-8205-c5410bddfdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:08.165813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 251/482] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:08.169425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8c5-0d8f-4ae3-adee-e6a67d541812 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.169713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8c5-0d8f-4ae3-adee-e6a67d541812 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.169987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8c5-0d8f-4ae3-adee-e6a67d541812 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.171571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 232/483] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:08.177207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.177494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.177768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.196914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:08.198087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:08.201744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a8c5-0d8f-4ae3-adee-e6a67d541812 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.224598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.240512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.313727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 252/484] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:08.349427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.381736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a8c5-0d8f-4ae3-adee-e6a67d541812 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.447689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:08.448509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.448784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.449052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.469187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:08.478415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:08.479320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:08.480165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:08.482105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 233/485] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:08.489775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.533771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f708-8aa7-4407-82a5-eb91691ce31e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.608032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.615858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:08.617039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.617576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.618040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.632799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a96a-da63-4ac5-8092-f36f373cdd56 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.650207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-174a77e3-1a77-4720-ad97-9f1c9fbc4c9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:08.658189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:08.659602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:08.660429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:08.664750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 253/486] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:08.666104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39280-7948-4e61-aba2-e51232227a3d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.666393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39280-7948-4e61-aba2-e51232227a3d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.666670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39280-7948-4e61-aba2-e51232227a3d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.668253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 254/487] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:08.668968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39280-7948-4e61-aba2-e51232227a3d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.684848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:08.686247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.687001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.687469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.688763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:08.689755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:08.691876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef90ba-4a94-4404-847f-b2803889a1ba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:08.692817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.706710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 234/488] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:08.708804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.709312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.709791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.730196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:08.731564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:08.784316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39280-7948-4e61-aba2-e51232227a3d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.816174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 235/489] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:08.816174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.829092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:08.830074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.830865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.831141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.831918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:08.832544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:08.834453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1134e8f-be1c-443a-aba1-2ab4b812e200 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:08.843558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 255/490] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:08.844954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb19-e5e0-4972-92c2-d3b8e5db0214 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.845243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb19-e5e0-4972-92c2-d3b8e5db0214 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.845572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fb19-e5e0-4972-92c2-d3b8e5db0214 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.846978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 256/491] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:08.851543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fb19-e5e0-4972-92c2-d3b8e5db0214 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:08.895434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.929385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef50ed-d965-46b4-85d0-a402fd72fe3e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.941044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:08.964749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:08.965172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fb19-e5e0-4972-92c2-d3b8e5db0214 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:08.965549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:08.965862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:08.966140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:08.976538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:08.978005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:08.995592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:08.996460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:08.997295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:08.997295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:08.997295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:08.997295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:08.997295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 236/492] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:08.997964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.005032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.005189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.005358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.005638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.016026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e1961ddc-7726-4deb-b617-f190e11d794e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:09.024522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.025406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:09.026222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 257/493] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.026876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.027544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.027544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.044166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:09.045350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:09.110912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb9b2e-92a7-4f15-a28b-150a5825df82 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.125158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 258/494] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:09.133533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.136762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.156135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.156883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.157164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.157440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.168549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.170103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:09.188562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.190164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.191432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:09.191432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:09.191432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:09.191432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:09.196715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 237/495] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.196715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.219385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.252900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c6db0-8eff-4b8d-b4d8-0c73a5e64aae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.290650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.291771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.292084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.292510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.293257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.293619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.295003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.303808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c60c4-cd02-41f3-b451-ef3a254e5793 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.311679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 259/496] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:09.311679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.343748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.344457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.344747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.345017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.345788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.346086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.347464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.356593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 238/497] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:09.357627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.392694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.431653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dfe66-ea82-4d38-9684-31f9fbcb9ad6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.459357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8cac-177d-4794-825a-c4fa07b31c90 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.462329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.469148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.469953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.470362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.470662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.481565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:09.491047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.491966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:09.492775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 260/498] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.493451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.497685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.499230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.499619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.499995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.500807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.501188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.503201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.520671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 239/499] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:09.520671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.598828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c3826-cfa7-4293-83e1-4c71afdb801a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.609888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.617305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14947852-1975-4c07-927e-75883e0a6b52 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.634585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.635373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.635657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.635974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.643427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.644923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.649315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.650098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.650374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.650642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:09.660537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.661576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:09.662504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:09.663089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.663157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 261/500] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.663221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.663294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:09.681245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.682298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 240/501] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.683168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.716795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.768217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffd0f3-9a2f-4b1b-ba26-2a310b391a35 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.781599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90179-6c26-4668-8444-39b759b2beba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.802175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.802882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.803165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.803435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.804204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.804509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.805881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408523a5-d7b5-467a-b250-8da966f681dc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.813616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 262/502] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:09.814854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1228ff-c726-4155-93d8-968b9b9fe86d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.815136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1228ff-c726-4155-93d8-968b9b9fe86d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.815406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1228ff-c726-4155-93d8-968b9b9fe86d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.816650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 263/503] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:09.817325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1228ff-c726-4155-93d8-968b9b9fe86d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.821079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.821958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.822242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.822518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.829830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.831302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:09.847439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:09.848496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 241/504] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:09.849512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:09.859881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.918602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1228ff-c726-4155-93d8-968b9b9fe86d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.931386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:09.951757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2e4a-c845-4cd0-a502-9df117f8e81b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:09.952157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.952814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.953122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.953418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.954332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.954641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.956597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.985416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:09.986069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:09.986388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:09.986676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:09.987380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:09.987695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:09.989102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc3565-bcd0-4b1f-b724-764b6dd50b26 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:09.992869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 264/505] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:09.993684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.001153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 242/506] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:10.002275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.002564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.002841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.019168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:10.020388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:10.083011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.091876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 243/507] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:10.092691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.102397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2e9f-d0bd-46c9-8d5b-b91c9bf654bd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.137006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.137792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.138067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.138335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.148791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.150258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:10.168323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:10.169199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:10.170017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:10.170017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:10.170017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.170017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:10.170017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 265/508] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:10.170295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.191847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24b2a-e9ce-4d5e-a409-6f1712d79323 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.194015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.226121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.226713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.226991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.227285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.228119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:10.228428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.229865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.265121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 244/509] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:10.265758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.266762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8dc30-2ce7-41cb-afd5-7fe0cc94305e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.300839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.301479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.301760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.302036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.320165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.363908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee221d9-e4f1-4e09-980f-83c57df4a894 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.368880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.370319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.397714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.401930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.403252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.403754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.404290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.414652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.416144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:10.430526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:10.431466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 245/510] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:10.432477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.477463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 266/511] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:10.478230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.535281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30e2e8-4fda-40bf-bc22-1a2120923f75 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.548855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.569447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.570226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.570504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.570778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.574841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4211a-073c-4dfe-a7eb-51999340050c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.581145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.582603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.597105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:10.599700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:10.600566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:10.601624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:10.601624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:10.601624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.601624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:10.601624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 246/512] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:10.602120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.610634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.611318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.611605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.611913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.612642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:10.612950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.614329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.625637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 267/513] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:10.626431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.705873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4809a-b7cf-4b09-8d05-b2af1cf03992 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.723504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678004c-fc70-4dcb-8ab9-744302187536 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.740819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.741543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.741826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.742098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.757579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.758236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.758516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.758794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.759619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:10.759960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.761369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.774609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.777884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 268/514] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:10.778860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.809606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.811181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.821456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:10.878977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfeb0b-5ed4-47a6-b6cb-98ea692643c9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:10.910871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 247/515] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:10.911807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.912132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:10.912921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:10.913203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:10.913480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:10.923538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:10.925561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:10.943264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:10.944098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:10.944939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:10.944939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:10.944939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:10.944939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:10.944939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 269/516] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:10.945216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:10.980019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.014219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce242-ff09-459d-b258-a1ab7d04070e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.033157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.041957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89323e8-3615-4ea1-afb9-4db0bab705eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.046501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.047160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.047441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.047713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.048462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:11.049635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.050668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.061745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 248/517] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:11.062366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.076927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.077856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.078144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.078423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.085741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.087201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:11.102215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:11.103187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:11.104133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 270/518] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:11.105148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.167709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c82ba-f191-4319-9ac7-7f554a8a064f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.193596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.202169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.202824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.203107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.203382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.214201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f3f5c-dd4a-4fe1-90f0-fd95f30c2d0a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.247863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.248641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.248923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.249207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.259026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.260512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.268640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.270344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:11.277911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:11.278752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:11.279584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:11.279584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:11.279584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:11.279584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:11.279584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 271/519] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:11.279884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.285284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.371250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 249/520] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:11.372084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.384328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cae257-aad1-44cf-b7d3-8837a4a2ea75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.396873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.418113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.418769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.419052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.419338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.420087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:11.420398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.421765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.433164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 272/521] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:11.433942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.471890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba46eb-2fa8-452c-9e8b-1c19f9086217 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.494296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.505005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.505687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.505968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.506241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.506928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.508397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.528108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 250/522] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:11 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:11.532810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.533003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befc04b-1dbc-458b-9be9-758c825c3edc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.575814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.576641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.576935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.577215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.578235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:11.578553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.580737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.602565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 273/523] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:11.603516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.626002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.647683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79989-7293-4009-9786-b4571a199bb4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.684848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.685568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.685856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.686131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.686859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:11.687170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.688586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.701095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 251/524] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:11.701754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.718260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845617d-7cee-4fbe-90db-4e322502906c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.745344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.758208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.759009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.759294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.759571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.770896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.772370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:11.791262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:11.792298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 274/525] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:11.793824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.818928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366514-d49f-4cb1-94b2-87dc82de44e4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.856711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.857766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.858055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.858319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.865663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:11.867098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:11.882253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:11.883154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 252/526] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:11.884646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:11.888756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.910565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc021-3bfe-45cf-92ed-3c323a66307c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:11.948305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:11.948950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:11.949230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:11.949504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:11.993904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:11.996255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e44c-0603-4db5-a07c-9957c423a569 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.021736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.023339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.035206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.036033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.036313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.036587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.044331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.045726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:12.060764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:12.061620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:12.062529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 253/527] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:12.063442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.135748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.138666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 275/528] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:12.139696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.179568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31a04d-9b3b-4406-9313-9af685adb885 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.215330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.216038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.216284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.216558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.217272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.217576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.218950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.223623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.230524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 254/529] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.231309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.257205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb63a0-4eec-4725-b372-84605b0a51f0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.294545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.295130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.295415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.295692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.296511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.296823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.298263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.317938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 276/530] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.318790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.340139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78cdf8-3150-4f59-a59c-c0046a4a4883 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.365020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.377437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.378118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.378404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.378818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.379456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.379760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.381493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.398690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 255/531] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.399287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.431528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f8455-a190-4988-9cfe-de522d96561c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.466740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.467536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.467838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.468522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.470289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.480279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.481730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:12.501399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:12.502811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:12.503666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:12.503666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:12.503666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:12.503666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:12.503918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3b58-7df0-4cb6-bd2d-af429cf4190c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.504004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 277/532] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:12.504071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.543461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.544294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.544636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.544857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.552240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.553693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:12.568389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:12.569250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:12.570091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 256/533] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:12.570993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.619292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ced91-c6e7-47fc-95d9-35029bb6cd1d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.621081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.655809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.656491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.656770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.657042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.657868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.658689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.660153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.675867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 278/534] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.675867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.701101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf192f4-436c-40a0-b9e4-e157939501f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.740953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.741761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.742118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.742471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.743467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=b3d302dfefab4d4a9cad2b67c3c70268) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.743956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.745574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.757451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:12.758140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 257/535] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/role_assignments?user.id=b3d302dfefab4d4a9cad2b67c3c70268&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.759094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.821555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265290ec-48ab-4c76-a731-d9936a3de9ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.876489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:12.877707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:12.878150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:12.878623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:12.879366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:12.879676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:12.882188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:12.899332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 279/536] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:12.905040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:12.968506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7899-2b9a-409d-89d8-21f2537f3a71 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:12.981401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:13.034674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.035618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.036682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.037252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.039232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:13.040398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:13.041985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:13.046181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0075a-ca39-44a5-a65e-30925584e01c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:13.068937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 258/537] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:13.069347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:13.078773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:13.120268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.121065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.121340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.121607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.137026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:13.138794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:13.171851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:13.172830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:13.173696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:13.176255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 280/538] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:13.183006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:13.223657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3f930-dfad-4171-aae3-be0567a61a5a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:13.259325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.260008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.260293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.260698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.261572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=076ef080a9444bea928197a18d546cb3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:13.261888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:13.263335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:13.270310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 259/539] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:13 2022] GET /identity/v3/role_assignments?user.id=076ef080a9444bea928197a18d546cb3&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:13.380097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d20-4685-4301-abae-ff1c3b7e815e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:13.436257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.436925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.437219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.437497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.438350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:13.438659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:13.440709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162232-7718-4656-9aea-557aa357e3fa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:13.453521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 281/540] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:13.460598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:13.493789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:13.570950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a92602-4a10-47b5-ab69-aebbc191f32a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:13.606949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.607894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.608178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.608451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.609333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=8402cadd9aac46518a45b01b18ef1965) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:13.609638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:13.611132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f6452-75c2-43d4-8c38-da86f3c1a3e5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:13.617486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 260/541] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:13 2022] GET /identity/v3/role_assignments?user.id=8402cadd9aac46518a45b01b18ef1965&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:13.661059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417adbe-a626-45e5-8aee-5579c831e81c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.661242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417adbe-a626-45e5-8aee-5579c831e81c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.661518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417adbe-a626-45e5-8aee-5579c831e81c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.663023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 282/542] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:13.668749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.669062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.669312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:13.687581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:13.688877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:13.764507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 261/543] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:13.806992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417adbe-a626-45e5-8aee-5579c831e81c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:13.844083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:13.946558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417adbe-a626-45e5-8aee-5579c831e81c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:13.997690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:13.998485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:13.998760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:13.999030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:14.010197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:14.018087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:14.019977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:14.021027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 283/544] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:14.028910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:14.059451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:14.145191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701090c-3cb7-473a-bcb7-4c9e402f6526 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:14.181736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:14.182404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:14.182682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:14.182957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:14.183701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:14.184039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:14.185411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:14.194209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 262/545] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:14.200002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:14.330266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:14.342396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4233e3c-002b-4412-8dcb-f160d0e7e3bb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:14.389726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:14.390526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:14.390812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:14.391083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:14.402705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:14.404171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:14.421585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:14.422394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:14.423217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:14.423217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:14.423217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:14.423217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:14.423217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 284/546] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:14.428877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:14.578300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:14.594839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3362-fe10-41ae-be47-4e225f36083d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:14.637364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:14.638026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:14.638306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:14.638577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:14.639302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:14.639606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:14.641009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:14.656950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 263/547] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:14.662752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:14.798611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb52f2-f74c-42f3-90f9-3e45841167b6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:14.848909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:14.849628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:14.849911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:14.850188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:14.863718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:14.865195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:14.882246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:14.883186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:14.884572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 285/548] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:14.889061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.016113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0146-51a1-45be-a5b3-6e6578c08495 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:15.054835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:15.055558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.055859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.056146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.057023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:15.057335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:15.058845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a756-1c65-4d37-b649-4221759b0660 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:15.086592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.090304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 264/549] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:15.090782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:15.210749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4b7f0-979f-44b0-858f-3157bd852a44 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:15.244266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:15.244971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.245254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.245527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.334382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:15.335838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:15.337701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:15.369016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212a1-6f26-48f9-ac67-59c5fb03fffe None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.369316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212a1-6f26-48f9-ac67-59c5fb03fffe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.369576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212a1-6f26-48f9-ac67-59c5fb03fffe None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.370937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 265/550] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:15.377401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.377699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.377977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.390257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:15.405101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:15.406356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:15.495515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 286/551] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:15.501136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.519902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 266/552] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:15.597233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.632223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052226fd-4df9-4015-82a2-e7708f54a86e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:15.633896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:15.673218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:15.675047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.675618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.676127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.687512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:15.689427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-07e5f2b0-a51f-4e7f-8443-54f016afaa77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:15.709434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:15.710444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:15.711320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:15.711320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:15.711320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:15.711320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:15.712520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62cdf9-c1a2-47c6-af04-c77f83137a7b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:15.713929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 287/553] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:15.715649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b0c-35d0-4c86-a76a-1c6091546b9e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.716173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b0c-35d0-4c86-a76a-1c6091546b9e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.716645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b0c-35d0-4c86-a76a-1c6091546b9e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.722815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 288/554] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:15.723959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b0c-35d0-4c86-a76a-1c6091546b9e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.753662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:15.754380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.754659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.754931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.757908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:15.768668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-473477c8-3aa9-43a6-8805-68829f4ec50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:15.776690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:15.777606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:15.778525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:15.782579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 267/555] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:15.784463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.784732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.785004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.802952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:15.804258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:15.860022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b0c-35d0-4c86-a76a-1c6091546b9e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:15.884169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 268/556] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:15.885150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.902506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:15.903960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:15.904444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:15.905049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:15.906102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:15.906606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:15.909060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:15.924800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 289/557] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:15.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:15.948535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.009790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288fba-1605-43e1-b8a4-cbfd258867d3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.037057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.048142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.048820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.049099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.049370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.050139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:16.050243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81a3e-4483-4507-be5d-3ee1c7e2b979 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.050444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.051846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.059750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 269/558] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:16.060548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.090134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.090920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.091204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.091476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.102174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-af40ee3f-c4aa-4680-a7f7-8f50330076f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:16.110104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.111612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:16.112466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 290/559] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.113142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38d5-1c2b-4af9-8526-249b642094a7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.113142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38d5-1c2b-4af9-8526-249b642094a7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.113340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e38d5-1c2b-4af9-8526-249b642094a7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.114868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 291/560] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:16.116157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5466b-ed71-433c-8a01-ae06f6fb671c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.116442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5466b-ed71-433c-8a01-ae06f6fb671c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.116713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5466b-ed71-433c-8a01-ae06f6fb671c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.117907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 292/561] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:16.118725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5466b-ed71-433c-8a01-ae06f6fb671c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.165514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaef3-1b5d-48df-bfe6-6d66b820fc4a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.193498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.197450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.198249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.198526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.198803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.205821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.207252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.219563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5466b-ed71-433c-8a01-ae06f6fb671c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:16.221731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.222599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:16.223473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 270/562] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.223985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.256829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.257686 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.257970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.258243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.269034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.270368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.270480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6f7e6735-3814-44d3-8816-3b69eaf202d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:16.288887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.289775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.290746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:16.290746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:16.290746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:16.290746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:16.290746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 293/563] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.291302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.291588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.291867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.307628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:16.308829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:16.326244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179970e-eff3-43a2-b964-11a4b5f0f064 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.358989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.359638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.360231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.360523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.361322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:16.361624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.362991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56706860-605e-4812-91df-2f68beb9e4ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.370591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 271/564] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:16.371803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b69-465a-4374-9298-e2070eefec59 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.372126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b69-465a-4374-9298-e2070eefec59 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.372475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219b69-465a-4374-9298-e2070eefec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.380939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 294/565] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:16.380939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.394870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-54219b69-465a-4374-9298-e2070eefec59 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:16.396094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54219b69-465a-4374-9298-e2070eefec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:16.435935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.470786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 272/566] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:16.471624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219b69-465a-4374-9298-e2070eefec59 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.496903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbb230-c9a3-480e-baa1-b9313d7a1cc0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.510347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.532324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.532916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.533223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.533504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.534290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:16.534599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.536035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.547501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 295/567] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:16.548318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.570128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219b69-465a-4374-9298-e2070eefec59 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.604450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.605109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.605394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.605672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.606403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:16.606708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.608363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.619243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 273/568] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:16.620046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.646931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd0ac1-ce6b-4dbd-87b8-4ca7e5ba92b3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.662876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.681111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.681904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.682186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.682462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.692856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.694295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:16.711947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.713007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 296/569] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.714115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.718466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.722515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cd6ed-20a1-49b5-8a11-f9839769ee0b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.756398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.757274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.757562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.757843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.768316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:16.776094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.777013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:16.777870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 274/570] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.778564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.813558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8f97b-280f-4e67-9780-4d54b9c70b7d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.847092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.847913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.848199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.848478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.858698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:16.866539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:16.867517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:16.868380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:16.872108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 297/571] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:16.872809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.881602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1db2-f78f-4e6f-8fca-b17dc0c84722 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:16.900083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.915494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:16.916175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:16.916460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:16.916739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:16.917571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=da042356bb0f4417a8f2ace132cb9028) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:16.917882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:16.919314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:16.924656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 275/572] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/role_assignments?user.id=da042356bb0f4417a8f2ace132cb9028&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:16.925424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:16.966384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:16.976507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41624a-651e-4665-9408-53086f08fc13 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.015513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.016499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.016896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.017172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.026628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.028369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:17.044415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:17.045484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:17.046421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 298/573] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:17.047009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.058643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f969a-049b-43c3-8cf0-3d08ddabfbe5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.103759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.104462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.104745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.105020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.105737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.106263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.107649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.120805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 276/574] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.121358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.148533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.162253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8cc15-20cc-48e6-b0ec-c536c6e4c0a8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.199734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.200421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.200712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.200985 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.201735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.202042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.203391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.215970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 299/575] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.215970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.217585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.239399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70910-3885-45f6-b3cb-59da6194934e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.277451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.278490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.278942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.279457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.280232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.280538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.281909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.296839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 277/576] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.296839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.318567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97a1-e802-4372-bfd3-a6a3012eb588 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.353024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.353610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.353896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.354168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.354991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.355300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.356747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.379360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 300/577] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.379360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.390289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.405282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44598a23-03d7-4c48-95ec-2eff0c5518fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.443091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.444071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.444357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.444635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.452525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.454625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:17.468532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:17.469486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:17.470420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:17.475178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 278/578] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:17.475563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.480067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.488551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5060-f878-4cbb-b781-e4a72c8fc1d2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.524418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.525397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.525513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.525718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.536607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.538001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:17.556054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:17.556973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 301/579] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:17.562535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.588090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c0a8-a7e6-4460-bcf0-88f576082d57 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.622928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.623758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.623908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.624134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.624489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.637259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.638720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:17.657649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:17.659187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:17.660127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:17.660127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:17.660127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.660127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:17.660127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 279/580] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:17.660952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.671876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6d42-e1b1-493b-8051-4e8eeb31a838 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.708875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.709666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.709953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.710231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.718136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.722421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.724015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:17.741887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:17.742761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:17.743645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:17.743645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:17.743645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:17.743645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:17.743645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 302/581] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:17.743978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.766578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5570b-7dd3-40f5-8e4f-8867d66528ca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.800522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.801189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.801468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.801743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.802566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.802874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.804338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.822081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 280/582] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.822920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.860548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec83a0-da38-4513-884c-07112c960dc0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.875548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.899557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.900330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.900674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.901013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.901912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.902219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.903568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.920508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 303/583] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.921156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:17.926560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f58d-7a65-4aa2-a81c-33ff17334218 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:17.940958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:17.963557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:17.964365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:17.964722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:17.965067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:17.965851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:17.966227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:17.967661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:17.983353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 281/584] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:17.983353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.038396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942ed7-5d44-434e-bb71-81221c79dff9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.075718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.076428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.076766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.077058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.077789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:18.078099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.079594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.093195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd91399-0321-4dc8-8bc1-9f517a757774 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.096348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 304/585] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:18.101132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.127949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.128676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.128958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.129236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.136422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.140282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.141769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:18.161668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:18.162798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:18.163898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:18.163898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:18.163898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:18.163898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:18.163898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 282/586] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:18.164212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.193667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.226410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53f1a-418d-4c7d-bdca-a4400dcdd4eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.264098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.264891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.265175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.265274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7118c6a-074c-42f7-b9c5-33970bd80c3e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.265456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.273279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.274840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:18.290360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:18.291484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 305/587] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:18.292727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.303973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.304876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.305078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.305332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.313046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.315044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:18.329178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:18.330152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 283/588] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:18.331102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.391535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.401695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839879-867b-4b01-87d3-832755ecb172 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.431273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.441068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.442531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.442823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.443372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.448096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20e31-c63d-4fd5-9134-2c8235a9264f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.452469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.453911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:18.472873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:18.473770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:18.474667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:18.479238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 306/589] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:18.479920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.487750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.488464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.488753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.489030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.489928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:18.490246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.491631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.504750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 284/590] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:18.505935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.591060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0e034-4e12-4620-828a-6c33a07ab742 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.606793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3733b2b-2aa7-4b5d-a4d3-b13b65c7969b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.627589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.628448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.628797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.629195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.630094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:18.630615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.632295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.642733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.643340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.643626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.643928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.644774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:18.645082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.646521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.656000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 307/591] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:18.656000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.667434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.672971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 285/592] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:18.672971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.675202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.773347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c3972-a78b-4436-ae32-a19b7138242e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.776807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf1d6-4f54-43dd-bcac-131a7aeaaf64 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.813499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.814484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.814867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.815239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.815332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.815978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.816265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.816503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.817289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:18.817646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.819081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.822990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:18.824482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:18.835992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 308/593] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:18.835992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:18.839062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:18.839967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:18.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 286/594] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:18.841381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:18.909113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.914924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:18.948573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04905331-bcfa-4d6a-a3fa-5a834ac75313 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.949778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c083a-69b5-490d-8cb9-b5c86783d6a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:18.990919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.991763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.992085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.992362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:18.992978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:18.993778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:18.994062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:18.994341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.003242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.004808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.008808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.010233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:19.022891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:19.023782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:19.024880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:19.024880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:19.024880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:19.024880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:19.027775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:19.028674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:19.029557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:19.029557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:19.029557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:19.029557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:19.029777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 309/595] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:19.031038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.034143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 287/596] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:19.035174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.152450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a99cb-c8e2-4770-b0de-e64fc4b3943a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.155571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f3d7-d6d0-459e-8608-59f212ac0058 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.175097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.183747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.195062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.195725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.195913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.196060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.196342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.196802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.197085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.197188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:19.197360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/b3d302dfefab4d4a9cad2b67c3c70268/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.197463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.198852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef690dc-6bbd-4b5e-b7d8-8b47eb538d40 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.215817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 288/597] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:19.217185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00975-8d05-438b-9f6f-2300938ea9d7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.217478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00975-8d05-438b-9f6f-2300938ea9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.217748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d00975-8d05-438b-9f6f-2300938ea9d7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.224049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 289/598] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:19.224049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00975-8d05-438b-9f6f-2300938ea9d7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.224323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=b3d302dfefab4d4a9cad2b67c3c70268, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.224323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.255853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 310/599] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:19 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/b3d302dfefab4d4a9cad2b67c3c70268/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:19.255853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.354408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d00975-8d05-438b-9f6f-2300938ea9d7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.360852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c61ed-04fd-4898-aec1-66b2a876d555 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.393727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.394393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.394677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.394952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.395700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:19.396039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.397806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.402147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.402571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.402849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.403124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.403868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:19.404183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.405542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0264-0cb5-4b28-b5ef-e71c42ebfbd2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.414445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 290/600] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:19.415548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.419073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 311/601] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:19.420439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.420725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.421000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.441119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:19.442726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:19.452584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.476504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.522986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 312/602] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:19.523850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.537249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97bd95-8c89-44ed-b743-c244eb086d2b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.573294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.574190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.574473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.574750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.592382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=34be797ec47b4d66aba7a9fa13419dd6, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.593834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.619865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 291/603] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:19 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:19.619865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.644463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1e771-9bec-42e1-873f-f9280bcb67ec None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.682951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.684041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.684454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.684787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.693690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.695443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:19.714759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:19.715702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:19.716634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:19.721751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 313/604] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:19.722925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.730540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.756388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c983fa-ed41-4b6e-b48b-ede84edd6dfe None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.761559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:19.809442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.810295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.810579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.810855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.819096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:19.822127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:19.841259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:19.843122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 292/605] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:19.845023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.874836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782ff40-cebb-4c9b-b34d-fa3c777550f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:19.917318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:19.918175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:19.918459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:19.918735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:19.933019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:19.944950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:19.947216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 314/606] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:19.949365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:19.986837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058b9c9-9e09-41e3-83b9-76880ee7c1ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.033917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.034782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.035183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.035681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.037126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:20.037438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.039130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.055393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 293/607] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:20.056150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.056789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.067711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.080036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0557d4-8a2a-435f-ba23-85c14fed9b0c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.122006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.122718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.123095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.123464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.124503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:20.124911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.126588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.145531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 315/608] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:20.145531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.190185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b7d7-2b42-4fb1-a9ed-1a31663edf1d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.235619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.237195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.237714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.238104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.239053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:20.239456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.241052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.254502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 294/609] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:20.254502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.282029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b2ede-6433-4243-9a76-f28b7c300774 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.319339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.320418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.320796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.321165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/076ef080a9444bea928197a18d546cb3/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.339004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.341339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.344613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=076ef080a9444bea928197a18d546cb3, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.347699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.372969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 316/610] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:20 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/076ef080a9444bea928197a18d546cb3/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:20.372969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.417252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9720-2340-4df8-ac69-c0f01217b072 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.541492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bfe7-3d80-465c-b7f1-afb583eb91b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.544533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.545452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.545736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.546026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/8402cadd9aac46518a45b01b18ef1965/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.566868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=8402cadd9aac46518a45b01b18ef1965, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.568684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.587556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.588420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.588709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.588972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.589382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 295/611] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:20 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/8402cadd9aac46518a45b01b18ef1965/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:20.602499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.604009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:20.624390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:20.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:20.626282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:20.626282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:20.626282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:20.626282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:20.626282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 317/612] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:20.632343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.746955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00acf68-11f4-4a9b-a7b4-5a3b87647fa6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.767106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.786931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.788245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.788526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.788993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.789834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:20.790501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.792035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:20.805968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 296/613] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:20.813773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:20.869734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:20.930273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0597f63-283e-43e9-8a6f-d54caf297935 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:20.967282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:20.971843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:20.971843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:20.971843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:20.989283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:20.990730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:21.006452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:21.007427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:21.008406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 318/614] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:21.013744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:21.184739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa32ad-87fb-478d-b18d-1f4acbb7e7aa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:21.239912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:21.240587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.240872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.241149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.241990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:21.242300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:21.243728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:21.262404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 297/615] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:21.268236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:21.402486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed5fd4-b8d1-4245-8bc9-21adce3f3d55 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:21.404853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:21.449015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:21.449862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.450143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.450418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.466004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:21.467449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-25e44eab-f99c-47f7-8330-02c9481ea45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:21.493663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:21.494604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:21.495494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:21.495494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:21.495494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:21.495494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:21.495494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 319/616] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:21.500988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:21.528739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca385-2cec-47d9-a309-ab7374f06f66 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.529025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca385-2cec-47d9-a309-ab7374f06f66 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.529305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ca385-2cec-47d9-a309-ab7374f06f66 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.530915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 320/617] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:21.535850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.539845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.539845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.541482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:21.572272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:21.573460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:21.653513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f15cc4-b3ce-44f4-9d8c-87195f5ad564 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:21.693179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 321/618] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:21.713373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:21.714049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.714329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.714596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.715320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:21.715622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:21.717087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:21.737124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 298/619] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:21.742729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:21.752524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:21.888621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:21.915596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a185-6843-456e-a760-ef94aaaf5df2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:21.928683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:21.936190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4067482-ab46-456e-884c-84a96526c35e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:21.973787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:21.974588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.974876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.975133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.982603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:21.984205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:21.984877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:21.986172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:21.987042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:21.987527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4a855b40-9b1a-43a7-805b-85e8b033ca0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:21.998394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:21.999305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:22.000257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:22.003865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:22.003982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 322/620] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:22.005214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56d2f-3863-42b2-bbe4-3e71177ee128 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.005503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56d2f-3863-42b2-bbe4-3e71177ee128 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.005779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56d2f-3863-42b2-bbe4-3e71177ee128 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.007275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 323/621] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:22.008893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56d2f-3863-42b2-bbe4-3e71177ee128 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-54132fbc-ffee-41fd-97b3-874244f39c93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:22.012908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:22.013806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:22.014626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:22.017784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 299/622] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:22.019182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.019666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.020178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.038996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:22.040357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:22.115013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 300/623] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:22.115896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.150739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56d2f-3863-42b2-bbe4-3e71177ee128 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.192304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.193425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.193729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.194007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.194951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:22.195271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.197335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.212763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 324/624] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:22.213899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.221644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.224190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.239866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b2b29-785f-4a52-bdd9-bf0535e79824 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.278304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.279065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.279457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.279927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.280734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:22.281145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.282616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.292005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 301/625] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:22.293037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.329870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31386f6-6ee9-4fe4-b945-00b2975613eb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.367120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.367977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.368264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.368537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.380269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:22.388714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:22.390642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 325/626] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:22.393555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.403788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd80fc-37f0-48f5-a8ad-d891bfab1df5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.438362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.439799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.440114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.440392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/da042356bb0f4417a8f2ace132cb9028/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.455914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=da042356bb0f4417a8f2ace132cb9028, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.457297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.461786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.469758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.476348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 302/627] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:22 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/da042356bb0f4417a8f2ace132cb9028/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:22.477421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.513517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52f127-4df9-4f95-a03a-0c50f0cb0d86 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.568219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.569147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.569502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.569850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.582942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.584547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:22.603425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:22.605381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:22.607739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:22.607739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:22.607739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:22.607739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:22.611844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d619d7-4927-41e3-9ef2-4fbc277f9845 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.612140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 326/628] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:22.612140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.658910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.660150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.660444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.660725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.661917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:22.662386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.664186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.676294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 303/629] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:22.688900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.737359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622f62-a8fc-4457-a6ca-290b3338a0b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.760644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.784820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.785493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.785778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.786058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.786794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:22.787134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.789327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.795492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:22.808028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 327/630] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:22.815757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.848824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaba45f-369d-49cf-9e2a-c78dad21b883 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:22.895299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:22.896264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:22.896555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:22.896832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:22.909392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:22.911376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:22.932339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:22.934384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:22.936471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:22.936471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:22.936471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:22.936471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:22.936471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 304/631] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:22.940469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:22.967608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbf75-3000-4c4a-bcf1-094599d204ee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.022366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.023091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.023372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.023645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.031149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.032619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5a216cd4-9f3f-4238-8ff8-082ad86d407c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:23.047478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:23.050209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 15:57:23.052512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:23.059847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc342-a5fc-4842-a95d-0805558c7f64 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 328/632] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133365ea-d78a-4f47-b655-3dfba3d859e7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133365ea-d78a-4f47-b655-3dfba3d859e7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133365ea-d78a-4f47-b655-3dfba3d859e7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 329/633] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:23.060078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133365ea-d78a-4f47-b655-3dfba3d859e7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.072749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.096375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.097039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.097419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.097697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.098529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:23.098838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.100254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266985e-9b08-4746-9d9c-8fb5b0404e38 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.103700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.115227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 305/634] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:23.116877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31c01-baeb-4507-b7c7-adb90838e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.117341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31c01-baeb-4507-b7c7-adb90838e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.117785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f31c01-baeb-4507-b7c7-adb90838e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.133947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-42f31c01-baeb-4507-b7c7-adb90838e8b4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:23.135140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-42f31c01-baeb-4507-b7c7-adb90838e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:23.171617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133365ea-d78a-4f47-b655-3dfba3d859e7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.205772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 306/635] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:23.207395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7660dd-d77b-456f-9217-776c52806441 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.207957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7660dd-d77b-456f-9217-776c52806441 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.208429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7660dd-d77b-456f-9217-776c52806441 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.213662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 307/636] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:23.213662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7660dd-d77b-456f-9217-776c52806441 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.214755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.215420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.215701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.217813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.218665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:23.218978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.220972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40572df-1d81-4583-9c48-6e88d82a7b96 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.242120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 330/637] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:23.243783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.244357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.244825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.263381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:23.264942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:23.329648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7660dd-d77b-456f-9217-776c52806441 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.331702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.339818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 331/638] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:23.344023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.371709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.378882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.379797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.380214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.380594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.388092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.389647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:23.405069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:23.406233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 308/639] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:23.411889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.455166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d430d-ead4-4679-89df-93d366d8f1d9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.490561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.491379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.491657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.492066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.502663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:23.510516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:23.511615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:23.512503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 332/640] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:23.513181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.521828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988e5b-9086-496c-8cea-cac42aee234a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.557797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.558796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.559338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.559610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.593115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.602351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.618352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239c96-1012-4fc4-b796-7b3cf66ffae4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.635674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.637262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.655694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.656792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.657075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.657349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.668575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:23.676887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:23.677924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:23.678816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:23.682691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 333/641] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:23.683505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.744861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 309/642] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:23.745974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.790338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a764e6-565d-4d94-843b-eab30c75e6e1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.824027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.827385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.828098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.828379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.828689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.829541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:23.830145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.831330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.853115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 334/643] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:23.853115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.856054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:23.869752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6b2cb-2a18-499a-9d89-ff37e5ff10a8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.907045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:23.907715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:23.908539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:23.908820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:23.909622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:23.909911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:23.911293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:23.920967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 310/644] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:23.925660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:23.964294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294398e-87e8-4758-abdf-3b95fa287f2b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:23.999647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.000498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.000844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.001120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.001888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:24.002194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.003549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.015753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 335/645] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:24.015753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.049281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a2d18-3c06-4c01-ac31-cf95b3694ab2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.074912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.089141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.089533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.090991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.091381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.091659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.105288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.106681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.126056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7de02-27da-444a-b256-50b648052a08 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:24.126198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.127047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.128376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:24.128376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:24.128376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.128376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:24.128376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 311/646] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.128701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.164277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.164925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.165200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.165474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.233500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98e63-7847-49d9-9441-c6f024866ad5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.234999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.237267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.269509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.270304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.270584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.270866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.281780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.283799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:24.300805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.301716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.302600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:24.302600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:24.302600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.302600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:24.302600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 312/647] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.302888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.314352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.338048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.358285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 336/648] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:24.358285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.414345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31efc9b-ec92-4aa0-a83e-f4d9826b3dad None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.452305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.453100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.453381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.453654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.464577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.466010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.468199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04879d4b-5af1-4972-b41c-b7d8aca8192f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:24.483515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.484500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.485409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:24.485409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:24.485409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.485409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:24.485409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 313/649] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.485702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.507374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.508065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.508346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.508614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.509328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:24.509632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.511008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.526771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 337/650] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:24.526771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.553885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.578639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.599231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a1c4-2d98-44e6-b4f9-a91f2cdd6daf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.635088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feafd2c-1b13-4306-b432-7f1e54f7004c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.635649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.636426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.636615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.636886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.637603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:24.637907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.639263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.651568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 314/651] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:24.652410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.677928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.678721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.678999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.679270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.690919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.692416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:24.710748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.711668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.712630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:24.712630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:24.712630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:24.712630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:24.712630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 338/652] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.712920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.759520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa26c6-748c-499e-96ba-4703726c6d06 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.795008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.796050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.796343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.796618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.797284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.797711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:24.798569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.800421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.809226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:24.813445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 315/653] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:24.819154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.822322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75f61-aaba-4e54-8e1e-3a44e921270e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.856791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.857834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.858110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.858380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.865653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.867083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:24.881443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.882586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 339/654] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.883835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.921147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf546fa-1b99-46be-8fcc-92b3dddc1d1c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:24.953174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:24.953959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:24.954237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:24.954507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:24.962231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:24.963654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:24.977772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:24.978738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:24.979689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 316/655] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:24.980771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:24.980855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53146c1f-0378-4d5a-aa69-746e566e9847 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.014028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.014672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.014941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.015210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.015953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.016255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.018245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51f891-e7cd-4658-8e57-ee208494d33a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.024443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.029900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 340/656] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.031118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997034-f1ec-4ffa-a9e7-a9aa9e76f3d0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.031404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997034-f1ec-4ffa-a9e7-a9aa9e76f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.031680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997034-f1ec-4ffa-a9e7-a9aa9e76f3d0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.033731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 341/657] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:25.034439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997034-f1ec-4ffa-a9e7-a9aa9e76f3d0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.042456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.083140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8bb6b-afaf-4e34-a1a3-ef32722a8bd8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.119082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.119923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.120210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.120495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.128152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.129589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.138425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997034-f1ec-4ffa-a9e7-a9aa9e76f3d0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:25.144116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:25.145253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:25.146282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 317/658] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:25.146921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.174994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.175580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.175894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.176169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.176950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.177261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.178663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.194753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 342/659] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.194753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.244494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cf1f2-4ddb-43fe-b02c-f8789a3547b6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.253749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.269458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.282658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.283453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.283740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.284040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.284890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.285198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.286625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a6396-3dfd-4c3f-8883-d15d18651106 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.296671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2b4b-2b87-4d6c-bf2a-1d521d94957d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.303750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 318/660] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.305040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.305333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.305609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.321689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:25.323007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:25.334966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.335758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.336079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.336356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.343304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.344752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:25.359164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:25.360080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 343/661] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:25.366311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.389054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 319/662] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:25.390098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.460420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67d3b-0596-4c8e-8a02-e90da197ca17 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.478960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.496340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.497009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.497291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.497564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.498390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.498697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.500126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.500989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467ae3-43ef-49e2-ab8d-8c8111270ef1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.510085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.518047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 344/663] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.518856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.540963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.541609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.541888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.542160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.542980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=b3d302dfefab4d4a9cad2b67c3c70268) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.543288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.544838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.551198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 320/664] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/role_assignments?user.id=b3d302dfefab4d4a9cad2b67c3c70268&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.551908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.637087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0258f-034d-44b0-ade4-93d26a78c1b0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.661132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f36108-a570-493a-ad4f-784fa3ab2e72 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.675472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.676283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.676568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.676840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.700153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.700848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.701127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.702134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.702252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:25.702509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.703971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.716817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 321/665] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:25.717562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.736896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.756133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.764223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:25.765801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:25.842326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398113d-c84a-4881-95fa-a28c9fc7e641 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:25.875066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 345/666] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:25.875941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.883948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:25.885139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:25.885574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:25.885996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:25.897820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:25.906495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:25.907631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:25.909247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:25.911657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 322/667] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:25.912604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:25.961241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:25.989685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b1295-921e-46a7-b5eb-cc68a1085de0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.013464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.024656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157968-3857-49fd-a349-1a3d358ff512 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.027015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.027744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.028060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.028341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.062545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.063200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.063483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.063760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.065209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:26.065528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.067018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.074467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 323/668] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:26.075500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.112425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.114265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.200674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.226035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051af69-9c8e-447e-995f-d12788880acf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.230578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 346/669] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:26.231806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.272034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.273269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.273792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.274302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.285522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.286963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:26.305451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:26.306432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:26.307353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:26.307353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:26.307353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.307353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:26.307353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 324/670] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:26.308114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.321336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.361251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e97c-ff1f-4966-be21-203f606c93ef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.400595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.401271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.401556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.401836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.402656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:26.402968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.404432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.413451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 347/671] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:26.414315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.442658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ba75-16ab-4f50-896a-4c06636ed059 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.456407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.488778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.490773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.491272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.491767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.509566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.512001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.524151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e15388-07f5-4d91-920b-59001d161798 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:26.534407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:26.535312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:26.536261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:26.536261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:26.536261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.536261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:26.538305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 325/672] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:26.539140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.572165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.573449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.574480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.575221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.576445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:26.577354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.579221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.596922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 348/673] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:26.598091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.607074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.654638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8983e0-d1ad-4e32-b9ba-eeab937729b0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.705935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.707478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.708306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.709061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.724013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.726194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.729335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed98f45-8279-480f-aa51-11c01300ba7d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.732152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:26.750461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:26.751439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:26.753018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:26.753018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:26.753018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:26.753018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:26.753018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 326/674] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:26.753927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.771251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.772338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.772829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.773331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.774312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:26.774825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.776469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.788767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 349/675] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:26.789941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.869994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb55ce-1bf7-46ff-bd0a-973949b0cec7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.884897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:26.909153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.910300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.910792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.911300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.918537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.919848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44648f7-7a80-4a7a-80df-e39db98b345d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:26.920493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:26.936188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:26.937105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:26.937974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:26.940488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 327/676] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:26.941546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:26.958219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:26.958896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:26.959182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:26.959596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:26.960514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:26.960826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:26.962805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:26.980494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 350/677] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:26.981687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.009180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.058189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff148-fe86-425a-a1ca-df08f6d1e76b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.106135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.107201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.108066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.108652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.116828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.118542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.118674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b09c-e3d6-4e63-afc4-6a8e7e46361f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:27.134016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:27.134929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:27.135807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:27.138299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 328/678] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:27.139285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.157440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.159694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.160203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.160713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.161760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:27.162285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.164036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.176884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.177084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 351/679] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:27.178382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.263207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483534-3542-4952-a969-2474ff9523a5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.264172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.294072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064d937-f995-4447-8888-f0bf4869f6d7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.306535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.308261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.308698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.309136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.320289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.322631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.333123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.333783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.334062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.334338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.335122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:27.335432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.336874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:27.341487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:27.342602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:27.343812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:27.351842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 329/680] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:27.353153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.355467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 352/681] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:27.356651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.472294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d08d6-c3c4-4ca0-9084-c835bb7ac960 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.473640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.483714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f47e82-7334-482f-afe9-d8e4761b7f7c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.523370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.524084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.524359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.524636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.525465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:27.525772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.526485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.527189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.527607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.528130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.528605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.530540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=076ef080a9444bea928197a18d546cb3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:27.531045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.532688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.536157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.541588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 330/682] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/role_assignments?user.id=076ef080a9444bea928197a18d546cb3&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:27.542605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.560544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 353/683] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:27.569257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.671068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f288-8a7b-422b-ab7e-60a3785a1642 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.720223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.720998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.721327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.721602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.722713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=8402cadd9aac46518a45b01b18ef1965) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:27.723033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.725526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45f05c-5e76-4e75-9cd1-eba4dbfbff19 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:27.734944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 331/684] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/role_assignments?user.id=8402cadd9aac46518a45b01b18ef1965&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:27.737003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a0c0-9efd-4620-87c5-34b5b79eb1a0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.737293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a0c0-9efd-4620-87c5-34b5b79eb1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.737567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a0c0-9efd-4620-87c5-34b5b79eb1a0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.739371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 332/685] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:27.745131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.745449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.745694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.769578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:27.771362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:27.791321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc57a-3db6-4318-991a-00f0c78c9694 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:27.792673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.842491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:27.843091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:27.843446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:27.843812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:27.875732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 333/686] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:27.901210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:27.934915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:27.942967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:27.944449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.027707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13e342-c4aa-4a20-b40b-174a22563105 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.063636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.065032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.065316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.065592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.067940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 354/687] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:28.073704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.080235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.081689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:28.101105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:28.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:28.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:28.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:28.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:28.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:28.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 334/688] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:28.109704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.114963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.207159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.214143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53774a-8db6-461b-9a8e-c25feb996692 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.266240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.267449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.267984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.268478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.269122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f1c-0e30-4a82-b850-e73558105068 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.290417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.292369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:28.312061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:28.313003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:28.313893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:28.313893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:28.313893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:28.313893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:28.316802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 355/689] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:28.322798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.328011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.328489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.328773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.329048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.329833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:28.330146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.331527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.346210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 335/690] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:28.353447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.434711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9a589-e4ee-4f90-8ea3-bd7bc5bba5c6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.478824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.479585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.479991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.480311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.480612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.481567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:28.482212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.483658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f39a9-e5f5-45cf-9df0-21f9b60d362f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.498250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 356/691] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:28.504179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e963-0dce-457c-ac48-477f0c9882b0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.504480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e963-0dce-457c-ac48-477f0c9882b0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.504834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e963-0dce-457c-ac48-477f0c9882b0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.506193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 357/692] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:28.507001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291e963-0dce-457c-ac48-477f0c9882b0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.518043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.525954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f292701-a1a3-41ff-8f07-c6cb9a066d1e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.565716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.566668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.567220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.567641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.568643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.570224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04c24-4ad7-49a5-abde-ddba3752c61a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.601130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 336/693] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:57:28 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:28.601130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.601130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.601130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.617981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:28.619351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:28.703605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 337/694] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:28.704072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291e963-0dce-457c-ac48-477f0c9882b0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.745977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.794891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.795730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.796042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.796314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.804641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:28.806238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:28.806906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:28.823481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:28.824461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:28.825392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:28.826607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 358/695] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:28.831981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.874059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f946e-cd76-4d68-9333-afa65ee0a97f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:28.924977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:28.926417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:28.927552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:28.927863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:28.928141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:28.945698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:28.955681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:28.956828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:28.957666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 338/696] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:28.965138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:28.974703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51e2f2-6731-4615-beff-a224ac4f588c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.014663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.015652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.016053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.016424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.017484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:29.017890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.020115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.033669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 359/697] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:29.038998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:29.094672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade19cd-5c2c-4c34-9067-d2d401666070 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.117273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:29.153453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.154022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.154309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.154588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.155351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:29.155659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.157082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.169670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 339/698] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:29.175863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:29.230967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d762a7-b400-45f6-8615-deee63b62f42 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.279982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:29.299919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.300741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.301123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.301501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.302448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=da042356bb0f4417a8f2ace132cb9028) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:29.302864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.304438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.320731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 360/699] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/role_assignments?user.id=da042356bb0f4417a8f2ace132cb9028&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:29.344530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddb39-8cdb-48a7-9f28-319e9d3de4cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.381327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.382324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.382885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.383263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.395013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.396772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:29.416009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:29.417100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:29.418185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:29.418185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:29.418185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:29.418185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:29.419855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 340/700] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:29.429200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:29.576865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592301e1-e999-4cae-a7c3-f872b406bcaf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.613065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.613977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.614443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.614875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.615744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:29.616229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.617735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.630820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 361/701] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:29.636389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:29.664274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:29.749030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0071e-276c-4d09-83c4-655f5fabc830 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.785929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.786975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.787430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.787884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.796327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.798043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:29.813422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:29.815144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:29.816212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:29.818428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 341/702] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:29.824061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:29.880584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:29.930388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d5db8-6a0f-47ba-88c6-2ed08875696d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:29.967125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:29.968116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:29.968546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:29.968968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:29.969943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:29.970475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:29.972062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552821ee-999f-4eef-9d91-8f5fe0dd9a49 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:29.990357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 362/703] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:29.995998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.102822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.131555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6ea06-94b3-425b-8e3f-649e346bfa41 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.179443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.180132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.180419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.180696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.196597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9770341-d3fc-499c-87da-6ba6169d677b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.196905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9770341-d3fc-499c-87da-6ba6169d677b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.197163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9770341-d3fc-499c-87da-6ba6169d677b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.198782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 363/704] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:30.203598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27bb4-0cf3-4dec-afae-1dc379ea99f1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.203908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27bb4-0cf3-4dec-afae-1dc379ea99f1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.204182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27bb4-0cf3-4dec-afae-1dc379ea99f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.221330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e3a27bb4-0cf3-4dec-afae-1dc379ea99f1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:30.222521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3a27bb4-0cf3-4dec-afae-1dc379ea99f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:30.273339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.274799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.295718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 364/705] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:30.302521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c288b2-b009-4922-9d72-b004e8eeb870 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.302880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c288b2-b009-4922-9d72-b004e8eeb870 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.303338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c288b2-b009-4922-9d72-b004e8eeb870 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.304957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 365/706] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:30.310799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cff28-ba77-4434-b108-66e218723edf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.311169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cff28-ba77-4434-b108-66e218723edf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.311453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cff28-ba77-4434-b108-66e218723edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.336294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a58cff28-ba77-4434-b108-66e218723edf None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:30.337560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a58cff28-ba77-4434-b108-66e218723edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:30.374953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.383271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.403833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 342/707] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:30.409179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.425195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 366/708] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:30.426050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cff28-ba77-4434-b108-66e218723edf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.534664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cff28-ba77-4434-b108-66e218723edf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.541472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682b28c-f3b6-44a8-8ab4-c3182aa935f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.579840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.580648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.580928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.581250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.581901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.582130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.582921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.583202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.583301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.583475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.595096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.597040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:30.597924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:30.598884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:30.599719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.604097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 343/709] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:30.605136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:30.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:30.622997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:30.625244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:30.625244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:30.625244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:30.625244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:30.627967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 367/710] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:30.628607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.663259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.663581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.733690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ece342-1826-4ebb-a596-2abd0b1d2e5d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.756645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe51c5-fc37-4827-b851-875b3780ad42 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.768876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.769901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.770199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.770650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] PATH_INFO: `/v3/services/network` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.771461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.772951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:30.785710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:30.786705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:30.787536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 344/711] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:30.788367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.804251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.805784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.806270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.806997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.807923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:30.808660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.810991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.823731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 368/712] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:30.823731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.921130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.922760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc28fa-0a5a-4b6a-97d7-2191f2b61325 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.936049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:30.944599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263cec-b062-4530-975a-47d00ff0bcc3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:30.963599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.964511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.964694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.964931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.965654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:30.966237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.967649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:30.986767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 345/713] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:30.986767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:30.995799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:30.996536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:30.996815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:30.997134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:30.997892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:30.998267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:30.999625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.004622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 369/714] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:31.005668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.110678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb1e5-0ea0-40a7-8f47-a7f31d228455 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.131632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15612c-3a54-46d7-8d2b-0d8218280d76 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.148329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.148986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.149265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.149538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.150242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:31.150587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:31.152164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.167862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 346/715] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:31.167862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.190507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.191707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.192223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.192700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.200273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:31.209167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:31.210865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:31.244318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:31.245360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:31.246269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:31.248856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 370/716] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:31.254617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.270324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865107b3-4d96-4cd8-908f-fd855c6cc777 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.279291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:31.317524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.318205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.318513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.318784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.319477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:31.319780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:31.321265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf00-d710-4f7e-b948-c7455c5c4215 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 347/717] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:31.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9367-da2c-4438-886d-b9de0717b991 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9367-da2c-4438-886d-b9de0717b991 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9367-da2c-4438-886d-b9de0717b991 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.331854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 348/718] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:31.341931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.342269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.342486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.377564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:31.381430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:31.472399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cc7b1-bca6-486a-af1c-fc33ab3f1765 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.512237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.513012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.513198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.513461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.514299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:31.514560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:31.516015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.522675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 349/719] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 15:57:31.530064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 371/720] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:31.535380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.555525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.573117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:31.674611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:31.710697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bb868-b472-4c99-8e89-ef724e3a10b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.732295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbdd4-02b8-4f14-8ac1-bd3e8650766d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:31.775098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.776032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.776384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.776734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.788475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:31.797290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:31.798228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:31.799643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 372/721] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:31.808255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:31.808644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:31.808940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:31.809334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:31.809764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:31.810673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:31.810987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:31.812473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af795e3-ef0e-4bd2-b2e1-fe32d6aa0985 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:31.819328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 350/722] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:31.963564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322731-5fb1-455f-b964-9097cde15db6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.005408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:32.010169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4addf-9314-421b-a6d1-b935738b6738 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.010699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4addf-9314-421b-a6d1-b935738b6738 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.010986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4addf-9314-421b-a6d1-b935738b6738 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.013836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 351/723] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:32.018884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.019183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.019376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.019528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.019738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.020287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.020566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.021393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:32.021642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:32.023025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:32.043139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 373/724] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:32.048113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.049331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:32.051114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:32.187912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 352/725] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:32.222997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5810f5e-c5d5-483a-aa60-df762db5d082 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.260021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.268589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.269695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.270210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.270703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.282332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:32.284187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:32.302472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:32.303452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:32.304382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:32.304382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:32.304382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:32.304382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:32.305327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:32.306888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 374/726] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:32.312451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.370542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:32.423211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20ff7-d889-4f47-a785-8191e982151b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.462002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a978b8-4743-4184-ac3c-afe967e15d21 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.481452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.482823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.483529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.484904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.506491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:32.517428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:32.518402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:32.519246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:32.526444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 353/727] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:32.528751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.529983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.530477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.530956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.532727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.533180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:32.533724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:32.535296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:32.564127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 375/728] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:32.571170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.709468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:32.740342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dfac-8911-4629-b0f1-360dd02870bb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.749977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140e34-47c8-458a-8769-06e8952b5658 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:32.754825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:32.781731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.782780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.783793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.784297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.785572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:32.786083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:32.788138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:32.798087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 354/729] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:32.805027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.818479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:32.819623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:32.820150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:32.820643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:32.830802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:32.832489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:32.847782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:32.848706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:32.849623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:32.852139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 376/730] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:32.860836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:32.972194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768b4a5-b3e9-480b-b364-c48c6f6ac08d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.031913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81aa2-b23d-4fa4-8acf-abadb68bdd19 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.036988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.038033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.038528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.040456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.062233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.064543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.073590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:33.094868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:33.095788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:33.096704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:33.096704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:33.096704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:33.096704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:33.103917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.104596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.104879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.105159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.106002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:33.106313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.108037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.109971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 355/731] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:33.110902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.132175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 377/732] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:33.152912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.194540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.241113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc190-e758-4165-886b-b4461e11a166 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.278335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.279005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.279393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.279677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.280531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:33.280843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.282265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.295782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 356/733] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:33.298281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3432e-8406-46b1-9665-203d012cf0ee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.302203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.364930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.365756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.365938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.366312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.366813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.414894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df95b-b8c6-4d62-8eaa-55db6f3c68f8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.450233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.451674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.465185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.465990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.466268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.466543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.484053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.485743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.503612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:33.511567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:33.512540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:33.513508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 357/734] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:33.520836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.638410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1317-70d8-42e0-86d9-d2570ddf7108 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.655704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.664673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 378/735] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 15:57:33.672240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.685572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.686249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.686529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.686800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.687640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:33.687981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.690402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.730411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 358/736] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:33.735632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.805579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44ed58-57c1-4f5f-8873-7c25fa0efbac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.830158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.842244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.843581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.843968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.844307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.848268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548e51-94b3-4a88-b9ff-625b2aee0fe8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:33.855605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.857304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2124e27e-0ee5-4f2d-b6c2-895d354fbd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:33.878715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:33.879675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:33.880629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:33.880629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:33.880629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:33.880629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:33.884440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 379/737] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:33.885865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ff94-8142-45c6-9670-db2ac30ec2ca None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.886150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ff94-8142-45c6-9670-db2ac30ec2ca None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.886420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ff94-8142-45c6-9670-db2ac30ec2ca None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.888359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 380/738] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:33.889150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478ff94-8142-45c6-9670-db2ac30ec2ca None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:33.890114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:33.891001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:33.891483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:33.892141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:33.938945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:33.965452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:33.966912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe237d-a83b-4d43-9493-25a9e2fbaaa8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.001038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478ff94-8142-45c6-9670-db2ac30ec2ca None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.040202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.040857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.041641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.041921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.042643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:34.042949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.045171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72ed0d-1ded-4178-8ccc-729ad6e27fe0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.057307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 381/739] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:34.058780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.059133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.059473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.073075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 359/740] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 15:57:34.077341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:34.077341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:34.078552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f5d-9c66-415a-b836-0285edef07eb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.079021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f5d-9c66-415a-b836-0285edef07eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.079480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957f5d-9c66-415a-b836-0285edef07eb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.081894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 360/741] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:34.082638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957f5d-9c66-415a-b836-0285edef07eb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.111892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.153042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 382/742] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:34.153790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.167668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.192862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957f5d-9c66-415a-b836-0285edef07eb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.227433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.228263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.228549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.228826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.235703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.237195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3a742125-de30-45b6-8411-f88c20695cef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:34.250710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:34.252246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 361/743] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:34.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.253698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.253698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.263040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfab31-1208-4960-8388-9572402a1f23 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.270637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:34.271843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:34.296434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.297214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.297740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.297740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.308295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.309749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-42e8f320-7ee3-4431-aae1-f63261cc0275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:34.327561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:34.328475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:34.329352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:34.329352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:34.329352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:34.329352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:34.329352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 383/744] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:34.330649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3db50-2e8a-44a2-bdc0-e8bb5303a6a2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.330949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3db50-2e8a-44a2-bdc0-e8bb5303a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.331215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3db50-2e8a-44a2-bdc0-e8bb5303a6a2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.332646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 384/745] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:34.333239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3db50-2e8a-44a2-bdc0-e8bb5303a6a2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.343642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 362/746] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:34.344504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.350752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.411201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.435280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3db50-2e8a-44a2-bdc0-e8bb5303a6a2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.449106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff2c3b-16e3-4dba-bc43-907029ad7376 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.468916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.469563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.469841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.470109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.470839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.472216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.483211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.484076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.484359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.484627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.485404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:34.485708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.487299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e5f1-c4cc-4aac-8686-182cdd45ff58 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.488255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 385/747] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:57:34 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:34.489527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.507039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 363/748] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:34.507039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.507039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.507039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.522523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:34.523943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:34.601033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.639857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 364/749] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 15:57:34.639857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.640150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aea1ac-b098-4396-bea9-5e2bda6ce16e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.685535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.686141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.687477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.687477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.687477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:34.687942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.690149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.704085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.708746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 386/750] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:34.709594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.767501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799aded8-bf7a-4e6c-bc10-5a249ae30a56 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.803033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.803702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.804374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.804653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.805423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.806785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.814983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60784a7f-1f52-42c4-b4d1-4763f2f71b01 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:34.831856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 365/751] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:57:34 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:34.831856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:34.862035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:34.874575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:34.875367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:34.875723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:34.876095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:34.877667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=22d4d07cc700460f8898c69d66268e54) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:34.878054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:34.879737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:34.886323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 387/752] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/role_assignments?user.id=22d4d07cc700460f8898c69d66268e54&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:34.887244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.022727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6399a-2af3-40a7-a68d-75cda7ad025a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.041591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:35.081858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f2a7-5def-4bc7-babc-92e28b445aec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.089192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.089486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.089729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.090008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.117678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:35.129234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:35.130188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:35.131022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:35.132832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.133881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.134354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.134818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.135404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 366/753] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:35.136857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.143519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.145285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:35.163527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:35.164500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:35.165377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:35.171963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 388/754] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:35.174668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.257912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc914d-5864-4a39-941e-c1d2a6babb5b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.268346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:35.295093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.296122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.296603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.297155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.298130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:35.299197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.301160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.311197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 367/755] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:35.316339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.349692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:35.410567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538f00-7d52-4d80-ae37-95df0b35777c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.424370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc97a-6cda-40d2-8f7c-90d674d40c18 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.458621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.459753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.460303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.460773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.472376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.474114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:35.491940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:35.492848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:35.493797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:35.493797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:35.493797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:35.493797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:35.496063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 368/756] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:35.499916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.500832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.502206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.502858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.503695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.508790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:35.509113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.510653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.550296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 389/757] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:35.564886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.598316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:35.614436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b7004-c146-47d3-b1de-d2d488ba7abd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.648997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.650030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.650511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.650979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.651914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:35.652429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.653976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.666877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 369/758] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:35.676793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:35.736050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc6f8-bb97-4171-81e2-0d29f9fa8875 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.756196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:35.777570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.778229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.778511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.778792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.779624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=da042356bb0f4417a8f2ace132cb9028) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:35.784895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.786358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.798213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 390/759] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/role_assignments?user.id=da042356bb0f4417a8f2ace132cb9028&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:35.848676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c840-cd3a-40d4-a63b-609475fb9517 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:35.886830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:35.887651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:35.887960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:35.888241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:35.896590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:35.898027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:35.913632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:35.914615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:35.915544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:35.919694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 370/760] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:35.921318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:36.078859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879fce-f438-4a33-b1cf-ae8cd5aaa673 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:36.119645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:36.120276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:36.120550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:36.120929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:36.121766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:36.122076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:36.123500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:36.143029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 391/761] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:36.148920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:36.153098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:36.297553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526f54-1f11-44f8-b712-d8b832d43854 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:36.343553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:36.344739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:36.345285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:36.345777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:36.360480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:36.362757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:36.385122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:36.386016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:36.386930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:36.386930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:36.386930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:36.386930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:36.390182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 371/762] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:36.395103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:36.435606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:36.505174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b16b7-f7df-4680-829d-86639f346151 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:36.541271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:36.541935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:36.542215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:36.542488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:36.543210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:36.543514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:36.544903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:36.557406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 392/763] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:36.562943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:36.680251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:36.721809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cc4b-0cc7-4202-b01c-e59b263b9b39 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:36.770202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:36.771013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:36.771297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:36.771574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:36.778895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:36.784489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:36.799370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:36.800462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:36.801357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:36.805489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 372/764] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:36.806894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:36.949854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:36.961636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462420f-5f18-451c-9037-fc6e98da3e7f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.010877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.011547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.011843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.012122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.012912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:37.013220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.014637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25193-a217-4c8b-87cf-dfb1d241cb06 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.033222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 393/765] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:37.038733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.167760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc694de6-dae0-4773-93e6-011650fae113 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.168135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc694de6-dae0-4773-93e6-011650fae113 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.168337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc694de6-dae0-4773-93e6-011650fae113 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.169965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 394/766] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:37.189140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb252-f690-4933-8235-5f2630ae1ab2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.189423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb252-f690-4933-8235-5f2630ae1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.189682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb252-f690-4933-8235-5f2630ae1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.199021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da46-c715-42a3-9cdd-a75b44663235 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.215559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:37.217666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-37fbb252-f690-4933-8235-5f2630ae1ab2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:37.219541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-37fbb252-f690-4933-8235-5f2630ae1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:37.233559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.234792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.235293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.235773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.238644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=34be797ec47b4d66aba7a9fa13419dd6, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.240467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.275005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 373/767] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:37 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:37.305680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 395/768] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:37.337991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.444428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bbe6-1f2b-40b4-b8bf-b4fb32bc86eb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.444796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bbe6-1f2b-40b4-b8bf-b4fb32bc86eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.444989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40bbe6-1f2b-40b4-b8bf-b4fb32bc86eb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.446379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 396/769] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:37.447426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e94a-b800-46b8-8903-8a190c4c7e53 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.447707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e94a-b800-46b8-8903-8a190c4c7e53 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.451480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e94a-b800-46b8-8903-8a190c4c7e53 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.453042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 397/770] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:37.454222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.454508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.454818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.464906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba6c14-1759-41df-98c4-9c94a61a2add None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.476730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:37.477848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:37.502354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.503269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.503554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.503840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.504511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.506083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f48590ac-47bd-4167-ad37-d2f28344c157 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:37.518975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:37.519945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:37.520791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 374/771] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:37.522115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.522269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.522418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.545183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:37.546421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:37.548971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 398/772] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:37.549832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.568539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:37.586567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:37.625060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 375/773] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:37.626131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.688657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e1ec-c69a-4ac7-b65e-105942de8a9c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.726471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.727350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.727668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.728170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.728617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd88c-7b9a-45a1-8771-f3a36f49e82b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.729090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:37.729488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.731133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.741128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 399/774] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:37.741128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.769743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.770794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.771219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.771633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.782613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:37.791398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:37.792440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:37.793282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 376/775] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:37.793983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.830383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:37.831347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:37.860099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22414-55a4-4489-9360-01619f9f46c7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.902260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.903309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.903893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.904315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.905418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.906961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.922356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bc01d-6bbe-45de-b295-edf621a65e44 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:37.925084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:37.926169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:37.926992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:37.930230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 400/776] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:37.931182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:37.968773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:37.969787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:37.970831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:37.971174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:37.972223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:37.972596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:37.974718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:37.985865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 377/777] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:37.985865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.058177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6a6cf-67e9-4f7c-8af0-c2ebd8f40b9d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.083295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.090686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd334-6ff4-40f4-a203-c3fb067f2b2a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.098132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.098909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.099289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.099716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.100591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.101023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.102606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.113060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 401/778] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.113994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.117907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.131942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.132858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.133288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.133751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.134633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.135115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.136703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.141919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 378/779] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.143532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.227125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae00ca-8f75-41eb-8c0e-db366c84fb07 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.244614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555e64-7fde-4814-9bf5-c0b12134a062 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.264426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.265167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.265515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.265934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.266909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] RBAC: Adding query filter params (interface=public, service_id=17b927c1633f4bb1afb088a8a7371d58, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.267861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.269294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.281441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.282035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 402/780] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/endpoints?service_id=17b927c1633f4bb1afb088a8a7371d58&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.282857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.282968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.283452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.283962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.295374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.297141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:38.315184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:38.316088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:38.316981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:38.316981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:38.316981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:38.316981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:38.319176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 379/781] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:38.320253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.333255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.356542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.392982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0b8a-9d70-4508-88b6-d4b35e95243f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.424916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fcbd0-6c08-493f-8ed6-9a54740e49f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.430271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.431202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.431769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.432300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.433209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] RBAC: Adding query filter params (type=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.433772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.435463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.446582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 403/782] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.446582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.460537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.461206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.461793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.461793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.462461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.463796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4aa63-a0e3-4465-b8bb-9d5357e4ca72 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.472637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 380/783] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.474988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54ef4-a8f0-49c7-a46b-88df1f34af1d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.476038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54ef4-a8f0-49c7-a46b-88df1f34af1d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.476835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e54ef4-a8f0-49c7-a46b-88df1f34af1d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.479391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 381/784] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:38.480524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e54ef4-a8f0-49c7-a46b-88df1f34af1d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.566796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1784b4e-775c-4f40-a129-292ec4dc259a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.598517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.600987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.608068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.609148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.609511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.609840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.610959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.611373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.613326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280029-1eba-4cbe-938d-0a0cd1e7cf7e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.630834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 404/785] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.630834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.630834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.630834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.641798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e54ef4-a8f0-49c7-a46b-88df1f34af1d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.653624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:38.654822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:38.685074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.686267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.686697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.687310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.688968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] RBAC: Adding query filter params (interface=public, service_id=d96c4432d6014761bc12f3e3357c4324, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:38.689432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.691889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.706332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 382/786] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/endpoints?service_id=d96c4432d6014761bc12f3e3357c4324&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.706332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.740651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 405/787] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:38.744219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.854730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fa99a-c42b-498c-8a11-afeeff55fa5e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.864751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c8009-843b-4814-bea3-49bd2736a3ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:38.892830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.893653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.893933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.894201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.896357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.903187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.905784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.907765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:38.911953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:38.912883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:38.913671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:38.914152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:38.915060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:38.916800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:38.922754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:38.923926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:38.925098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:38.931895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 406/788] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:38.932379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 383/789] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:38.933574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:38.933691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.122355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2750a-d5c1-4f93-8508-9abd9f6baae2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.151866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971749-1d20-477c-af97-1fa5c2f0dd13 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.167863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.168986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.169510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.170105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.188083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:39.191185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.191185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.191384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.191633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.192512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:39.192826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:39.194265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:39.199286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:39.200375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:39.201228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:39.204148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 407/790] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:39.215168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.225877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 384/791] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:39.231337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.300137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:39.327705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:39.378350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117504e8-278a-46c3-b39d-308f3b6c183a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.399034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1029ba9-8cd1-4b57-84ab-bf1f542528c6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.423917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.425153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.426112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.426587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.438288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:39.440271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f5901b7d-0140-4136-97a2-2697c982c4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:39.460039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:39.461205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:39.462297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:39.462297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:39.462297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:39.462297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:39.464210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.464548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 385/792] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:39.465082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.465523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.465902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.466423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be412-7aa8-42bd-bf46-98cd796a4e24 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.466861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:39.466974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be412-7aa8-42bd-bf46-98cd796a4e24 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.467359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:39.467520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833be412-7aa8-42bd-bf46-98cd796a4e24 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.469176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 386/793] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:39.470005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833be412-7aa8-42bd-bf46-98cd796a4e24 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.470677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9129a-f5a6-4642-9503-34037760fbf2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:39.488070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 408/794] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:39.489742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.489996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.490349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.512359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:39.513700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:39.586338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833be412-7aa8-42bd-bf46-98cd796a4e24 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.596935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:39.606238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 409/795] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:39.608098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.629196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.629876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.630226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.630605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.631423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:39.631853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:39.633377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:39.652221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 387/796] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:39.653204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.772709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2843-ef01-463a-8523-1791fc831ff3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.791409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:39.816473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.817268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.817543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.817808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.830489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:39.838049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:39.838999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:39.840226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:39.844106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 388/797] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:39.844935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.876846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:39.881776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ddac-c005-4d0e-a871-6df08ba3d544 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.930046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.931582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.932484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.932946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:39.947157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:39.949594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:39.955515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1bd9-b671-4b4e-80d2-7c2c4eff7b5c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:39.974336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:39.975249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:39.976159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:39.976159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:39.976159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:39.976159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:39.978758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 410/798] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:39.980465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:39.992101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:39.993171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:39.993556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:39.993938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.002944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.004287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:40.020595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:40.021718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:40.022926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:40.024610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 389/799] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:40.025492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.103957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.118083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09760d-f8da-4aac-b858-7aeaad2902ae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.126177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.141065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f70345-5782-4143-a7fc-fe63d46acfb1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.166675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.167351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.167636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.167939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.169133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:40.169593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.171328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.186091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.186091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.186091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.186091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.186468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:40.186468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.186468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.186876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 411/800] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:40.187967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.200615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 390/801] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:40.201908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.294047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d98f3-9307-4cc4-a8e6-adc14b583ff2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.333021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.334166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.334662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.335134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.336154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:40.336662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.338272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.343490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96e22-25d6-4f6b-9dc0-d4f12dd0f118 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.351702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 412/802] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:40.352929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.368801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.388910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.389709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.389995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.390268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.403610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.405537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.415412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:40.427171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:40.428495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:40.429376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:40.429376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:40.429376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:40.429376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:40.431412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 391/803] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:40.432434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.473337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f977-d546-4872-a455-0f1e2885aa6f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.508810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.510014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.510531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.511002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.519407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.521168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:40.537502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:40.538500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:40.539437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:40.542062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 413/804] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:40.543294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.553878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acc2c-b3e7-453d-a380-49c01f752930 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.598182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.599086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.599372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.599660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/22d4d07cc700460f8898c69d66268e54/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.614959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=22d4d07cc700460f8898c69d66268e54, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.616443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.617528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.639856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 392/805] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:40 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/22d4d07cc700460f8898c69d66268e54/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:40.639856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.670789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc8287-317e-4577-9b02-9d69bf23071c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.691381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.723955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.724814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.725187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.725554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.726393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:40.726805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.728346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcea9ae-2979-4fe8-971e-54c0ff1ccfe5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.745954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 414/806] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:40.747664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f852-973f-4366-9d2a-45b54bc3bb20 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.748109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f852-973f-4366-9d2a-45b54bc3bb20 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.748478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f852-973f-4366-9d2a-45b54bc3bb20 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.752112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 415/807] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:40.754740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f852-973f-4366-9d2a-45b54bc3bb20 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.773846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a45a0-3769-4f7a-90cf-b0d1836b62a6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.826555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.827275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.827506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.827779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.828669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:40.828976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.830450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b630a-74eb-4c28-878d-aedef3df7c58 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.851786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 393/808] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:40.853184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.853544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.853862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.871816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:40.873053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:40.880546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f852-973f-4366-9d2a-45b54bc3bb20 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:40.919687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:40.926671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:40.927750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:40.927895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:40.928305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:40.936757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:40.938198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:40.953666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:40.954907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:57:40.956200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:40.958023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 416/809] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:40.958874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:40.970892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 394/810] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:40.971980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.021531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.098053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c024366-6772-4482-9186-2a3f3a99894d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.101181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b968a0d-3bce-43c6-9fef-838575245738 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.134857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.135647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.136067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.136405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.137362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:41.137685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.139199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.146979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.149912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.150365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.151786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.160881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 395/811] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:41.161802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.166743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.168437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:41.191743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:41.192888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 417/812] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:41.193819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.264966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.281931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.290277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332d9d-3c10-4fd5-870a-38569787ecb1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.326698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.327516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.327797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.328119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.328769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.330174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.337499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9089-57c5-4ed0-a7dd-eedd3d4279fa None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:41.342387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:41.343306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:41.349079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 396/813] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:41.349947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.378205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.378858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.379141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.379650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.451535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bf68c-ce16-4026-be68-661fa0a84f59 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.453254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.455270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.490499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.491163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.491610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.491916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.493451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:41.493783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.495140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afd8d3-d44c-4826-b2ed-5aa95058c56f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.503520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.513310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 397/814] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:41.514664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e43b6-7ad4-488f-abbd-ef8081855dbd None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.514955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e43b6-7ad4-488f-abbd-ef8081855dbd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.515245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e43b6-7ad4-488f-abbd-ef8081855dbd None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.519857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 398/815] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:41.519857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e43b6-7ad4-488f-abbd-ef8081855dbd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.543505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.569047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 418/816] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:57:41.569047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.634266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e43b6-7ad4-488f-abbd-ef8081855dbd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.669535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.670249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.670534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.670788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74efffa-d72a-470e-b21f-2cdf91d144d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.670915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.671559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:41.671895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.673319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b2235-0382-4fc4-ad78-5f0dc8252f3a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.678174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 399/817] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:41.679459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.679749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.680059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.697325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:41.698656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:41.710002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.710725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.711003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.711267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.717848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.719267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:41.733617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:41.734480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:41.736010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 419/818] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:41.736533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.740225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.778093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 400/819] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:41.778931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.808969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:41.855906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2840-45a3-4270-b300-62d9034ac6f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.895946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.897008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.897509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.897853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.901354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba30e6-2231-44f2-935c-87b0caa91feb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:41.909097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.910518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:41.928548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:41.929852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 420/820] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:41.930734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.943439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:41.944139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:41.944654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:41.944761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:41.945389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:41.945697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:41.947074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:41.951866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 401/821] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:41.952563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:41.994453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.033606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.042958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4452-0d13-4866-8364-c9e4d850cbc2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.057309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604c4d-bbb7-45fe-8480-e19faa015e1d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.084816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.084816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.084816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.084816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.085190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:42.085190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.085870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.098185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.098981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.103887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.104005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 421/822] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:42.104084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] PATH_INFO: `/v3/services/network` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.104171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.104259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.104259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:42.117041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:42.118020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:42.118876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 402/823] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:41 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:42.119659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.212739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982dc42-e8cd-44d3-adb2-fb52c8681d4e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.224364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9f046-a3cd-47db-953a-ea814dc7b416 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.229810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.249936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.250599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.250945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.251309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.252824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:42.253195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.254553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.260918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.261574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.261860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.262144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.262865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.264250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.266153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 422/824] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:42.267099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.283628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.292068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 403/825] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:57:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:42.293740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.410520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4def-4b2a-401d-b0f0-ab03eaeef5ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.442179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9e40-eac4-4be7-8e04-1dc001971686 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.456939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.459474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.460609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.461164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/da042356bb0f4417a8f2ace132cb9028/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.463179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=da042356bb0f4417a8f2ace132cb9028, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.464743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.480084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 423/826] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:42 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/da042356bb0f4417a8f2ace132cb9028/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:42.481047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.496025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.496963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.497387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.497768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.499016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:42.499146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.501072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.510103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 404/827] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:42.517251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.537162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.620063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.634217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f20-afb2-405c-ac36-20afdb923b00 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.681807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913aaf1-baa0-4d38-a03a-2ae191ba4258 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.698328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.699285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.699966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.700254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.709558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.711507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.722345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.723107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.723425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.723661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.724852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:42.725216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.726649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:42.728482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:42.729346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:42.730262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:42.730682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 424/828] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:42.731876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 405/829] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:42.737886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.738031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.854581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a200567-ac7c-41d2-9376-9052395b8c10 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.856773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.865265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f295-9f01-4659-bb0d-9ec2ce9dde88 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:42.884289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:42.898225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.898986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.899368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.899644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.901070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.902823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.904080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:42.904749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.905030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.905300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.906089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:42.906397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:42.908357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccabee1-8edb-4c3f-826a-60557946321a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:42.921009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 425/830] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:42.922411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97546308-c818-40fe-b7a3-e8704152163b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.922705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97546308-c818-40fe-b7a3-e8704152163b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.922981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97546308-c818-40fe-b7a3-e8704152163b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.924086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 406/831] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:57:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:57:42.928443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:42.928936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 426/832] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:42.930513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:42.930807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:42.931084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:42.948677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:42.949911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:43.033771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 427/833] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:43.072082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ad43-7ca9-4472-b9e1-4e50f8afc361 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.087983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:43.144398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.145260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.146743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.147911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.148812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:43.152269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:43.153499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:43.162334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 407/834] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:42 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:43.196244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:43.218714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb8ff5-7d2e-43e9-bdbc-bfe359f35a42 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.258179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.259111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.259667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.260048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.273362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:43.281617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:43.283378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 15:57:43.284518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:43.286120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 428/835] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 15:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:43.292040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:43.355501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:43.427301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276a3d-fcd0-4bcc-bcfb-dd01b7e30c14 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.462732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.463400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.463683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.463989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.464736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:43.465039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:43.466463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:43.480404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 408/836] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 15:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:43.486238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:43.589167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a72f-2c04-4bb5-a3cd-aa65b29778bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.624147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.624949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.625233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.625510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.636818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:43.638250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:43.640012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:43.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:43.658629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:43.660070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:43.660070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:43.660070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:43.660070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:43.660070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 429/837] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:43.663808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:43.775400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f185-39bd-474b-bcfd-3fa90ba9ef4c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.777831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:43.816652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.817325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.817613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.817894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.818621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:43.818932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:43.820331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:43.833610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 409/838] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:43.839038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:43.944642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ea89b-a5bc-4af5-8b99-ed086c2fb56a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:43.979129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:43.979973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:43.980257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:43.980532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:43.988529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:43.989956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:44.004482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:44.006602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:44.008873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 430/839] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:44.015896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.117736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff0cbf3-ba49-4d98-9a61-a9f7d527ee28 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:44.153420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:44.154092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.154372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.154646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.155470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:44.155853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:44.157345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.175292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 410/840] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:44.180806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.239422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:44.287183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768edc7-f6ad-4db9-8132-c0726e717977 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:44.322058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:44.322706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.322993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.323264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.398432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:44.399797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cc9a8-7ea3-4c47-9a16-1d77b2e0bdc1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.456992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:44.507323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 431/841] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:57:44.512644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.539094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:44.629300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c520ce3-38b8-49ca-a4e8-472a133e8c0e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:44.664538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:44.665249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.665536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.665810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.677063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:44.678529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.683276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347869-de91-435d-bf73-d115578a3a8d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.683791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347869-de91-435d-bf73-d115578a3a8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.684299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347869-de91-435d-bf73-d115578a3a8d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.686086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 432/842] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:44.691710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.692255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.692731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:44.697092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:44.697965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:44.698837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:44.698837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:44.698837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:44.698837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:44.698837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 411/843] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:44.704766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.714541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:44.716372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:44.800190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 433/844] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:44.805853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:44.817316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.841366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6094-eb38-4b90-8254-5ef130dc508e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:44.890094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:44.890769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.891053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.891332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.892651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:44.892957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:44.894608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.914454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 412/845] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:44.915713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:44.919591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:44.941124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d77b-d92c-4270-b4d2-187a957b5771 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:44.977070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:44.977869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.978147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.978428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.979077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:44.980459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e0142988-4c2a-459f-8c31-47553db78aa6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:44.993528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:44.994725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:44.995562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 434/846] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:44.996408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48dbcf-98fe-4b8e-a51e-2cf42146e2dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:44.996583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48dbcf-98fe-4b8e-a51e-2cf42146e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:44.996860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48dbcf-98fe-4b8e-a51e-2cf42146e2dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:44.998271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 435/847] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:45.000671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48dbcf-98fe-4b8e-a51e-2cf42146e2dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.034431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b907-5042-4f15-89fb-7cbc58137104 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.067689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.068520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.068808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.069088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.070983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.077703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.079338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d140e0ce-c733-43ff-afd7-bba0a587ad30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:45.098349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:45.099464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:45.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 413/848] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:45.101124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.101124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.101490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.118668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:45.119910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:45.127344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48dbcf-98fe-4b8e-a51e-2cf42146e2dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.162456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.163126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.163411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.163695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.164507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:45.164817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.166231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.170812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 436/849] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:45.171603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.187043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.199887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 414/850] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:45.200956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.283071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433ac73-ebd8-4a24-a6e8-56031e51ee4b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.315128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e858eb-49e7-44ff-ad46-a57c22b81d64 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.319490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.320480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.320752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.321022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.321799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:45.322105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.323518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.336526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 437/851] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:45.340657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.341990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.358627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.360264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.361301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.361966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.363207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:45.363860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.366007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.384035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 415/852] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:45.384035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.429721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.462645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877596f7-fa60-4cdc-a2bb-d97ea34c63a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.496812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f02fa-ff07-4840-b948-0e13d9f48570 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.500124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.500932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.501212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.501514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.515675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5f568756-8947-4df8-95b1-26041deca5c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:45.527073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:45.528293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:45.529156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 438/853] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:45.529947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b8533-77a1-4196-b86a-9d8dd4ea3a22 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.530236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b8533-77a1-4196-b86a-9d8dd4ea3a22 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.530513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b8533-77a1-4196-b86a-9d8dd4ea3a22 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.531944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 439/854] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:45.536966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b8533-77a1-4196-b86a-9d8dd4ea3a22 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.551678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.552376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.552657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.552931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.553766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=22d4d07cc700460f8898c69d66268e54) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:45.554079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.555525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fde60e-3ea7-48eb-b2cb-51907d17882f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.561728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 416/855] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/role_assignments?user.id=22d4d07cc700460f8898c69d66268e54&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:45.562787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.563141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.563752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.582577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:45.583961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:45.644216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.660188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b8533-77a1-4196-b86a-9d8dd4ea3a22 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.671372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 417/856] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:45.694990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.698927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:45.704397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.705813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.706466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.706823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.707969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:45.708479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.710195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.721967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 440/857] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:45.725764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.818542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444aee-1c68-4d0a-ab79-a8a8a9d507c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.848722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738802-1141-4abe-9521-9d5b5c94ba66 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:45.871689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.873112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.873391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.873804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.874615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.877016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.890698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:45.891202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:45.892852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:45.893942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:45.894752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:45.894752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:45.894752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:45.894940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 418/858] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:45.901307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.907292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:45.908911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:45.936111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:45.937080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:45.938886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:45.938886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:45.938886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:45.938886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:45.938886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 441/859] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:45.945078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:45.961042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.008198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.013312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491bd00-fe4b-4219-ad5d-7b95fef9f93a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.052173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.053010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.053394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.053790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.054609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:46.055019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.056541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.061827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 419/860] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:46.067741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:46.073898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d863ac-2fab-4f2b-a9ff-1e5f51782597 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.122807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.123497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.123774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.124074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.125049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:46.125357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.127705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.143577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 442/861] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:46.148774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:46.182942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217b772-63cd-44b7-a886-8b3b2637ec9d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.194131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.224688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.226126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.226879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.227370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.228294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:46.228816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.231271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.238308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 420/862] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:46.272760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d24841-cbe7-40ec-9284-c9fb6e1f5ff8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.280657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.312062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.312888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.313167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.313446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.323101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.324647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:46.340260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:46.341271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:46.342214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 443/863] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:57:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:46.348272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:46.456195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035c7b-197d-468a-a0e5-b34050d70e2a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.492672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.493406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.493691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.494016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.494863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:46.495171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.496650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.515968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 421/864] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Jun 29 15:57:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:46.521673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:46.628930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323f4f-e246-47bc-a7f7-7f0ca0d09ff5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.665054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.665710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.666009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.666317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:46.706573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.736801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:46.738266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:46.847228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 444/865] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:57:46.852799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:46.886534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:46.959648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a854ad1-24e2-4cfd-95ed-5d74e59028c2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:46.994277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:46.995076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:46.995355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:46.995635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.006595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.008069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:47.026090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:47.026986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:47.027913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:47.027913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:47.027913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:47.027913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:47.027913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 422/866] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:47.033580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:47.103337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:47.139195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea163-e7c0-4f98-8add-fa3d0577a031 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:47.173988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:47.174652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.174937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.175216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.175969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:47.176280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.177636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.189959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 445/867] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:47.195414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:47.286047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:47.303115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9572-1d28-43df-8b0e-c72c7fa1c26e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:47.338331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:47.339189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.339472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.339746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.346624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.348093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:47.362314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:47.363183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:47.364102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 423/868] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:47.369527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:47.476867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ed22-6252-4209-86b3-11d7c163d040 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:47.508186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:47.513516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:47.514190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.514473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.514752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.515575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:47.515915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.517557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5e5c5-5b18-4510-bfab-880f3e50c01d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.535492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 446/869] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:47.541391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:47.560466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4559f-c877-4989-b111-8331953c9886 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.560807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4559f-c877-4989-b111-8331953c9886 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.561088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4559f-c877-4989-b111-8331953c9886 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.562681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 447/870] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:47.569223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.569512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.569787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.586942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:47.588281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:47.647329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e5-9aa0-4763-8929-5c9d64c410e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:47.668213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 448/871] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:57:47.681910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:47.682568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.682849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.683127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.684145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=da042356bb0f4417a8f2ace132cb9028) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:47.684452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.685050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:47.685876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f94b2f-fc29-47f6-86f0-3dbb9dfa6ce4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.692814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 424/872] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:47 2022] GET /identity/v3/role_assignments?user.id=da042356bb0f4417a8f2ace132cb9028&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:47.802502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0cc8-b8a2-4750-a258-f5236027c900 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:47.821762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838915-6770-466d-be46-33def9d515bc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.822098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838915-6770-466d-be46-33def9d515bc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.822314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838915-6770-466d-be46-33def9d515bc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.823796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 425/873] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:47.829229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.829546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.829829 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.837686 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:47.849994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:47.852104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:47.854759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:47.858452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:47.859134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:47.859415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:47.859690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:47.860460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:47.862418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:47.878827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 449/874] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:57:47 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:57:47.943291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 426/875] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:47.967518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.075392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7b00d-1467-4cc3-9a0c-b60030ffef2d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.112005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.112825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.113105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.113377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.123853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:48.132146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:48.133065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:48.133921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:48.138207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 450/876] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:57:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:48.139563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.244510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692c76-2d9d-42bf-8456-474aff09d2eb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.280463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.281132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.281405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.281682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.282427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:48.283305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:48.284697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8563322-6d52-4b06-952e-ad86b5c3280b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:48.286041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:48.298116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 427/877] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:57:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:48.299562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.336699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:48.404114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1304e-130a-45e6-9e1d-b7940d3a559c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.405670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c90a6-57f6-4b87-8295-8afb2a4e3724 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.405955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c90a6-57f6-4b87-8295-8afb2a4e3724 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.406225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c90a6-57f6-4b87-8295-8afb2a4e3724 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.408329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 428/878] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:48.413447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.413973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.414468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.436107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:48.438036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:48.444389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.445184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.445465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.445738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.459122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:48.461025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:48.482375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:48.483558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:48.484478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:48.484478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:48.484478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:48.484478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:48.488865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 451/879] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:48.490122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.526839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 429/880] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:57:48.544513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.608886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:48.612757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cf5-a6a2-413f-9eee-9ee78c525d53 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.651069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.652134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.652652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.653406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.654644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:48.655164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:48.656971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:48.671160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 452/881] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:48.672652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3204f-13da-4564-b6b6-2c7941380f25 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.676913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.711174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:48.722041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.722954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.723805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.724307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.725605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:48.727663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:48.748453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 430/882] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:57:48 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:57:48.797459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb08b6-e493-4560-92a2-d845d5d0d934 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:48.843860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:48.845129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:48.845724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:48.846196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:48.854783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:48.856650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:48.874185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:48.875210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:48.876183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:48.884092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 453/883] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:48.885892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:48.996128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070ac4e-082a-4866-8285-abf9c3b60a13 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:49.030454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:49.031487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.032001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.032495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.033577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:49.034081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:49.035728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:49.060011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 431/884] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:49.062607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:49.067502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:49.168796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec3a-7537-4a3a-9234-b1c0dc6875f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:49.203376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:49.204048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.204329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.204625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.276148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:49.277936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:49.280859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:49.380614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 454/885] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:57:49.388704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:49.433492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:49.491670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dae9f-ac37-406e-b3ec-4ae2833554fb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:49.526645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:49.527865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.528292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.528725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.540387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:49.542100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:49.566020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:49.567177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:49.568317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:49.568317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:49.568317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:49.568317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:49.574442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 432/886] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:49.576062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:49.677485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2b61-8dc2-4ce5-b6f2-785395bd4bc7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:49.679776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:49.712301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:49.712962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.713242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.713515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.714236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:49.714541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:49.715913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:49.727941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 455/887] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:49.733657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:49.836194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:49.844056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffa23d-ea12-4257-85e3-e27178f84b41 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:49.880445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:49.881243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.881525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.881796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.888766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:49.890233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0d00922c-20a0-4296-b917-df86b6da6aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:49.904630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:49.905581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:49.906717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 433/888] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:49.914462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:49.964046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b39de-d05d-4d45-9c41-5c7138ce6fc2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.964046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b39de-d05d-4d45-9c41-5c7138ce6fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.964046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b39de-d05d-4d45-9c41-5c7138ce6fc2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.965560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 434/889] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:49.969611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc282f0-26bc-4e54-afb8-9ab3debe02b8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:49.969899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc282f0-26bc-4e54-afb8-9ab3debe02b8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:49.970739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc282f0-26bc-4e54-afb8-9ab3debe02b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:49.992845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9dc282f0-26bc-4e54-afb8-9ab3debe02b8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:49.994400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9dc282f0-26bc-4e54-afb8-9ab3debe02b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:50.028507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15164ad-f545-4c4a-91d7-c6d33c2b480b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.062617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.063292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.063572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.064405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.065216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.065527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.067002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bde53-9029-4b8c-9232-b8c39b51cf99 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.088270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 456/890] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:50.090090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742178c9-29eb-44b0-b978-1d1919f59eff None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.090386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742178c9-29eb-44b0-b978-1d1919f59eff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.090663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742178c9-29eb-44b0-b978-1d1919f59eff None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.093417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 457/891] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:50.093417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742178c9-29eb-44b0-b978-1d1919f59eff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.120981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:50.185746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 435/892] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:50.193231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.194194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.194620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.208952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742178c9-29eb-44b0-b978-1d1919f59eff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.215578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:50.217122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:50.243678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.244350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.244643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.244917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.245741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] RBAC: Adding query filter params (role.id=f58c56e61bb84fc489eefd6f7180dfc7, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=22d4d07cc700460f8898c69d66268e54) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.246055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.247471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.263862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 458/893] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/role_assignments?user.id=22d4d07cc700460f8898c69d66268e54&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=f58c56e61bb84fc489eefd6f7180dfc7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:50.263862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.317528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 436/894] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:50.352999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.363503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:50.374187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:50.377918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0fd6-a03d-4ea8-b2d6-cd785752d25d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.415436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.416275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.416561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.416840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.417512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.418903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:50.432502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:50.433580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:50.434889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 459/895] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:50.441260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.475362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ab3f-42ec-483c-a518-0b05b5494b16 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.511714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.512554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.512835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.513117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.513758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.515134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:50.528038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:50.529058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:50.529965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:50.534287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 437/896] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:50.535156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.577366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab12bf6-a5d2-4719-93ed-8694a54f3d68 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.620531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.621480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.621765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.622040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.622746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.623411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:50.623538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.625840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.635968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 460/897] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:50.638562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.651965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac71b6-153c-4828-9739-c7641f1cf25a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.666399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:50.703241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.704995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.705453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.705878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.707015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.707968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.709740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.716544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 438/898] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:50.722160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.767240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a80bb-a870-48d4-a588-2801e357350f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.806587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.807776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.808252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.808671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.809777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.810253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.812483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.828137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 461/899] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:50.838876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100825b-505a-4b37-ba95-e968debdbc25 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:50.882432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:50.883107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.883387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.883723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.884479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:50.884835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:50.886246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8655158-5751-4529-988f-0de438c92f16 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:50.892483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 439/900] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:50.901146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:50.917104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0c7b-71a0-4096-8361-78f26e005f87 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.917438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0c7b-71a0-4096-8361-78f26e005f87 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.917669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0c7b-71a0-4096-8361-78f26e005f87 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.919336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 440/901] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:50.925506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:50.925811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:50.926071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:50.943751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:50.945021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:50.947361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.015561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.039438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 441/902] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:51.041168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508edaa-58c9-482b-9061-c6cce8320f5b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.062672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.079559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.080358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.080640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.080910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.081699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] RBAC: Adding query filter params (interface=public, service_id=30987d3bf45a4519851ed6fd4d86388e, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:51.082009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.083370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.089658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 462/903] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:57:50 2022] GET /identity/v3/endpoints?service_id=30987d3bf45a4519851ed6fd4d86388e&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:51.095869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.185770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefba39e-9182-4c3b-b4a4-5ae25c0fc78f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.214728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fdb5e-65b5-4060-b336-9075fca5ea5d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.230688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.232724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.233718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.234938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.235872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.237493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:51.250723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:51.251921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:51.252988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:51.259496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.259846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 442/904] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:51.260587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.261020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.261324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.261599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.262519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.264045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.264410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.280501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 463/905] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 15:57:51.388956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bf3-9401-4348-9904-56bd9cc663f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.426431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.427141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.427428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.427693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.428432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:51.428735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.430674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.435634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 443/906] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:51.440937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.453689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.555384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf97db-f796-4d6f-86ef-eef2dddd731e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.591861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.592523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.592804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.593076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.593839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:51.594144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.595625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.600955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 464/907] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:51.606632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.674969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.712450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec967f-0f60-4e93-9818-a4556600122d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.745942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.746874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.747330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.747776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.748757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] RBAC: Adding query filter params (interface=public, service_id=13d0ad7d3a9142e5b82df1e9e8611b7e, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:51.749259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.750779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb32c1-79a1-418e-974c-266519c9bb8e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.757027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 444/908] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/endpoints?service_id=13d0ad7d3a9142e5b82df1e9e8611b7e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:51.762596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:51.838738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:51.874101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d973ee-af03-4fa4-8330-1017de35598d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:51.909423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:51.910413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:51.910910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:51.911881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:51.912756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:51.914340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cff0bf-330d-4350-9e1d-4f4f4c731ba3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:51.920766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 465/909] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:57:51 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 15:57:52.427322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fd43-93bb-47a0-b28f-eb114e370bce None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:52.427816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fd43-93bb-47a0-b28f-eb114e370bce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:52.427816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fd43-93bb-47a0-b28f-eb114e370bce None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:52.429295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 445/910] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:52.434848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:52.435258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:52.435427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:52.452581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:52.453820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:52.526325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 466/911] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:52.549761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49fd43-93bb-47a0-b28f-eb114e370bce None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:52.658646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49fd43-93bb-47a0-b28f-eb114e370bce None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:52.687413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:52.693321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:52.694123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:52.694401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:52.694675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:52.706606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:52.714588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:52.715684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:52.716580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 446/912] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:57:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:52.722320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:52.785967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:52.826032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617b27a-8201-461c-96e7-e4617f4656a6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:52.863089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:52.864079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:52.864572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:52.865019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:52.865949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:52.866428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:52.867968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff29d44-e3c7-4e7e-8e1d-30da996400da None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:52.876665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 467/913] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:57:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:52.887867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:52.993677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02348cdf-bada-49be-bfcf-fd567e5088c7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:52.998242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ab3e-a887-49a6-8733-058b2e14f7f6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:52.998899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ab3e-a887-49a6-8733-058b2e14f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:52.999394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ab3e-a887-49a6-8733-058b2e14f7f6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.001312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 468/914] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:53.007502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.008136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.008621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.028678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:53.029863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:53.037483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.038578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.039596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.040130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.055209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.057182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:53.077639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:53.078576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:53.080109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:53.080109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:53.080109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:53.080109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:53.087796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 447/915] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:53.087796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.123006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 469/916] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:57:53.134661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.146771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.198620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc24d04-64b3-4d68-9bfd-773660bf7351 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.233185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.238311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.238980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.239555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.239927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.240662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:53.241019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.242391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.260087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 448/917] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:53.261318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.270435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f2e0e-0296-4128-8b79-136cc7161c25 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.307032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.308112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.308689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.309157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.310169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.311722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932f1fe-5eb1-4669-8952-a761016512aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.328031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 470/918] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:57:53 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:53.375150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84195b-5d4d-472a-8a64-4c077801d174 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.377467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.422332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.423763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.424080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.424354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.432967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.434845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.447923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897f08-201b-41c5-9a53-b5146358774b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.448866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897f08-201b-41c5-9a53-b5146358774b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.449339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a897f08-201b-41c5-9a53-b5146358774b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.451178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 471/919] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:53.455814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:53.456820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:53.457748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 449/920] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:53.458336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.458336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.458336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.459961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.477332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:53.478944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:53.567161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 472/921] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:53.579999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aec58-6a79-4add-ae9f-8f790eaaf58b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.590492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.621327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.622521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.622957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.623514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.625034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:53.625600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.628240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.647007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.647380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 450/922] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:53.653044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.673030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.701624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f7456-9bff-4cc9-b962-4d20b7b35bef None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.739754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.740835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.741395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.741852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.743150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.744949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.761328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f365-3412-4afa-ba5b-5d029dd78703 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:53.761784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:53.762962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 15:57:53.764044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:53.772327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 473/923] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:53.773053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.802217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.803017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.803302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.803604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.814538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.816658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:53.835028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:53.835952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:53.836845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:53.836845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:53.836845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:53.836845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:53.839932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 451/924] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:53.842011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.900713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec786e-c136-44a4-b0b3-96871796ba81 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:53.915272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.930091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:53.941104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:53.941776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:53.942063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:53.942342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:53.943056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:53.943366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:53.944875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:53.955033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 474/925] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:53.956112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:53.975018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794987-94ae-4685-a437-e7a8c2a851a2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.027522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.028365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.028765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.029048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.029780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:54.030088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.032322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.047985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 452/926] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:54.053596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.081455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dd05-7797-404e-b60a-f7efc012a653 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.120466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.121123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.121474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.121663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.122359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:54.122786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.124029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f478e-eb8c-49e8-9c3c-c37d5272e00e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.133861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 475/927] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Jun 29 15:57:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:54.133861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fc85-50fc-408c-a806-d5d63971ddff None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.133861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fc85-50fc-408c-a806-d5d63971ddff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.133861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fc85-50fc-408c-a806-d5d63971ddff None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.133861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 476/928] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:54.137467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fc85-50fc-408c-a806-d5d63971ddff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.167758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fe93a-d281-40c6-82fa-9fdc6b438d70 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.187816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:54.195727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:54.205468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.206329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.206615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.206938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.213879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.215322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-92fcc479-5b41-4604-949a-c493a407b47d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:54.230173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:54.231244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:54.232209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 453/929] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:54.232694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.232765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.233293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.249877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:54.251065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:54.265032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fc85-50fc-408c-a806-d5d63971ddff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.303342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.304020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.304300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.304579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.305338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.306678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.326204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 477/930] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:57:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:54.327143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.327525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 454/931] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:54.351365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.467303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7f07-ed4c-4698-b30b-339d3a96019e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.476948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:54.492390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:54.496278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3bfa-bb55-4530-bdee-f16cbb15776d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.522397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.524750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.524750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.524750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.524750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.525749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:54.539233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:54.540312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 15:57:54.541282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:54.544005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 455/932] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Jun 29 15:57:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:54.546611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.548791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.549562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.549965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.551237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.553163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:54.553590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.555086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.571198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 478/933] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:54.577694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.668835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647301c-9672-4aec-9b2e-cb301841d28a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.683231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83685c7-264e-4ddc-a2f2-c815bf944fb2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.706909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.707839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.708333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.708766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.709687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:54.710143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.711802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.722021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.722021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.722021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.722021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/22d4d07cc700460f8898c69d66268e54/roles/f58c56e61bb84fc489eefd6f7180dfc7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.722618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 456/934] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:54.723798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=22d4d07cc700460f8898c69d66268e54, role_id=f58c56e61bb84fc489eefd6f7180dfc7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.724334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.725408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.741115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 479/935] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:57:54 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/22d4d07cc700460f8898c69d66268e54/roles/f58c56e61bb84fc489eefd6f7180dfc7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:57:54.780307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:54.840490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac2c8-ccab-44a1-a735-4a3e4ef93571 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:54.879180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:54.880273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:54.880738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:54.881202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:54.882099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:54.882596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:54.884187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d28c-0154-47f2-b73c-03204c169904 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:54.894543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 457/936] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:54.895938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:54.914942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:55.005260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127edbb-2b34-4edf-b09d-76497577ffb8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:55.040854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:55.041561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:55.041850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:55.042127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:55.042871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:55.044263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d3d0f-6403-442e-9b0e-1aaba3318833 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:55.065152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 480/937] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:57:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:55.535548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156d86-2565-4076-a5a7-ca6d9f4f2bcc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:55.536134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156d86-2565-4076-a5a7-ca6d9f4f2bcc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:55.536134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c156d86-2565-4076-a5a7-ca6d9f4f2bcc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:55.537787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 458/938] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:55.543200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:55.543623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:55.543814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:55.561403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:55.562607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:55.628403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:55.640531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 481/939] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:55.664035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c156d86-2565-4076-a5a7-ca6d9f4f2bcc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:55.769352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c156d86-2565-4076-a5a7-ca6d9f4f2bcc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:55.779974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:55.807196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:55.807966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:55.808252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:55.808529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:55.809182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:55.810547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:55.823490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:55.824542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:55.825817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:55.828820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 459/940] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:55.831776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:55.943527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8afb-4539-4e89-8989-3c369a0fe74e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:55.978064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:55.978726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:55.979010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:55.979284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:55.980037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:55.980346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:55.981706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:55.987601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 482/941] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:55.993038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:56.113405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9df90-a4b9-4751-ad10-aa3626fdeadb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:56.146945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:56.147878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.148366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.148795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.149684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:56.150138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:56.151640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:56.157198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 460/942] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:56.163170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:56.221546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:56.265124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84c41-0d9f-49cd-a50f-ec88e9788483 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:56.310075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:56.310754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.311039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.311655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.312253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] RBAC: Adding query filter params (interface=public, service_id=44b1afaabb7c415bb58c523ae034fbc1, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:56.312544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:56.314202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88353277-ca12-473e-b184-d64264c7b4c9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:56.320206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 483/943] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:57:56 2022] GET /identity/v3/endpoints?service_id=44b1afaabb7c415bb58c523ae034fbc1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:56.325408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:56.373753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:56.441578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088b6a7-acc5-4075-be1f-5ca0c62c509f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:56.476624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:56.477294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.477514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8813-d786-4677-9dce-4de72a45cd71 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.477622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.477789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8813-d786-4677-9dce-4de72a45cd71 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.477887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.478049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8813-d786-4677-9dce-4de72a45cd71 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.478489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:56.479766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 484/944] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:56.479977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:56.485042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.485331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.485644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.486868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 461/945] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:57:56 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 15:57:56.507734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:56.509198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:56.587697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 485/946] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:57:56.611797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:56.732259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da0eb-c1de-4fd7-a972-8c4d16206508 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:56.734422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:56.769518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:56.770455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.770899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.771323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.772209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:56.773798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:56.775316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.common [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 15:57:56.795932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 15:57:56.795932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 15:57:56.795932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [parameters: {'id': '0638a8210e3f420eafbb2d32d4fbaff6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 15:57:56.795932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b71713d1-c49f-4b2f-95a9-b907de392d63 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0638a8210e3f420eafbb2d32d4fbaff6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0638a8210e3f420eafbb2d32d4fbaff6. Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:56.814415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 15:57:56.815438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application yield resource Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise self.value Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application session.commit() Jun 29 15:57:56.816649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.flush() Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application compat.raise_( Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 15:57:56.817674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 15:57:56.818772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:56.819676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [parameters: {'id': '0638a8210e3f420eafbb2d32d4fbaff6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:56.820566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:56.821352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0638a8210e3f420eafbb2d32d4fbaff6. Jun 29 15:57:56.822409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:56.824880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 462/947] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Jun 29 15:57:56 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:56.835874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:56.887328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:56.924178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3518d6-e954-4bdb-b455-77da337fa3c1 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.924467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3518d6-e954-4bdb-b455-77da337fa3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.924742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3518d6-e954-4bdb-b455-77da337fa3c1 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.933188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 463/948] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:56.934525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.934819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.935094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.938289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a6da7-15fb-4254-b659-eb9f680c22af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:56.957762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:56.959904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:56.973890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:56.974689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:56.974970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:56.975246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:56.982511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:56.984191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:56.999121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:57.000100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:57.000977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 486/949] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:57.006422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.044245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 464/950] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:57.069128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.131367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097863-e68f-4d68-84c8-a5f2ce4b10f7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.146564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.169007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.169673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.169957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.170236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.170998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:57.171304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.172787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.184060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.200151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 487/951] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:57.201969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e2428-4a5f-49b4-86b7-346d25814d42 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.243945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.245170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.245702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.246264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.259737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d3c8e996-bf93-4d87-b688-1b570937a517 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:57:57.268794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:57.269814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:57:57.270650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:57.273705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 465/952] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:57.280271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.342991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924d7c-f159-4bdc-96a6-3341dd9a14ca None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.343300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924d7c-f159-4bdc-96a6-3341dd9a14ca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.343545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06924d7c-f159-4bdc-96a6-3341dd9a14ca None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.345117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 466/953] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:57.350488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.350741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.350996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.371989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:57.373370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:57.406656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62801de6-37af-4cef-8e11-25ca8ab8f1cc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.448464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.449367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.449769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.450133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.450975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:57.451378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.452774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.458315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 467/954] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:57.463215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 488/955] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:57.468891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.480910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.524948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.557030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.583293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058ebf3-9208-4d8b-8762-8650413afa8e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.602986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3baed-5d24-429f-891f-48eeaea8112a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.622466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.623465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.623752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.624061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.635667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.637300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.638115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.639129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.639606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.640118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.641012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.642595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:57.656634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:57.659174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:57.660585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:57.660585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:57.660585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:57.660585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:57.660585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 468/956] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:57.663724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:57.664796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:57:57.665639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:57.666388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.672397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 489/957] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:57.677131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.788935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122688f-7007-4144-a7d7-500a079650f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.795112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.800562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffdd15-11ff-4f13-b7af-0cf276d65bed None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.829655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:57.837781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.838581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:57.838860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.839292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.839536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:57.839896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.840037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:57.840419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:57.841069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:57.841322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:57.841664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.841773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:57.843255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.843458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:57.851378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 490/958] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:57.857410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.867643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 469/959] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:57.869085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:57.983946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a271e-063b-4c6c-ab31-fc979fd683cd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:57.984518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bb87e-c610-45b5-aeff-8809c78eb0f8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.022022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.022691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.022983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.023544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.024157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:58.024467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.025914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.030027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.031102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.031597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.032096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.036316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 491/960] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:58.042150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.044089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:57:58.060942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:58.062004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 15:57:58.062976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:58.065919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 470/961] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:57:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:58.072065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.105075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.185720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb4601-83fd-4e03-a4c1-fbdc309af43a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.221682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.222362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.222649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.222934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.223766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:58.224110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.225536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.244865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 492/962] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:58.250286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.302453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.354823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257813b9-931a-4975-8e82-9a940bb3caa1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.389446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.390108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.390390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.390664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.462520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.464010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba578513-ffc6-451d-b89c-7d3efaf88382 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.513870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.566537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 471/963] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:57:58.572035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.629232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a016c-1475-4469-8cdd-9093ebec619e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.629773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a016c-1475-4469-8cdd-9093ebec619e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.629773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a016c-1475-4469-8cdd-9093ebec619e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.631371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 472/964] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:57:58.636184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.636470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.636742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.655814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:58.657021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:58.665151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.687571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6715-7a50-4a6f-a15d-8bae6a96b73c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.725083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.726218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.726695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.727145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.743845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 473/965] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:58.744004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.744004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:57:58.761020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:58.761942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:58.762842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:57:58.762842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:57:58.762842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:57:58.762842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:58.763062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.765381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 493/966] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:58.770972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.860291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.880827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dde9a-33db-4e5f-9814-8b57dc379c1d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.881018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f17a-fc7a-4103-a51a-573c5a3ad980 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:58.915561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.916322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.916600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.916871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.917322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:58.917637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:58.917944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.918123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:58.918416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:58.918691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:58.919334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:58.919891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.920843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:58.922234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:58.935317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:58.936442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:57:58.937276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:57:58.940346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 494/967] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:58.941274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:58.941497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 474/968] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:58.951879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.050347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f0f76-578f-47e1-8034-2d7a5ede7451 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.075135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe942c-ee6f-4b70-82a1-da1b20f92ff1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.092693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.093807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.094092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.094367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.104308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.106162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.116568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.117278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.117663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.118038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.118841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:59.119245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.120739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:57:59.123768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:57:59.124845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:57:59.126975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.132381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 475/970] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:59.132560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 495/970] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:57:59.132711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.133270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.145213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:59.205811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:59.242982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542d0f-cec5-49e6-8518-bc6efe425e55 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.253414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa88b-9345-4c48-b86a-11acb39db572 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.282522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.283440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.283954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.284421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.285451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:59.285900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.287589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.293310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.294056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.294409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.294757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.295534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:59.295951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.297515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.307904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 496/971] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:57:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:59.308407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 476/972] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:57:59.309040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.309661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.384048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:59.421498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308051c6-63df-4d22-999c-471f59889de2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.423571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4081d-5a39-4ad6-96d7-6d627966cea1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.450097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:59.465111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.465610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.465816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.466047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.466321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.466537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.466822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.467095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.467214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] RBAC: Adding query filter params (role.id=f58c56e61bb84fc489eefd6f7180dfc7, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=22d4d07cc700460f8898c69d66268e54) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:57:59.467444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.467832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.468905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0c231-3649-4876-a486-094b98f5541f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.469183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.474910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 477/973] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:57:59 2022] GET /identity/v3/role_assignments?user.id=22d4d07cc700460f8898c69d66268e54&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=f58c56e61bb84fc489eefd6f7180dfc7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:57:59.476187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333725b-4215-4589-b68b-d6c49256b096 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.476498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333725b-4215-4589-b68b-d6c49256b096 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.476751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333725b-4215-4589-b68b-d6c49256b096 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.482807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 478/974] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:57:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:57:59.484713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.485155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.485433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.496177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 497/975] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:57:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:57:59.508959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:57:59.510369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:57:59.608361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 479/976] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:57:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:57:59.631093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.745835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e4f5-cf9c-4bb2-a09d-22ed6ae97931 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.787637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.788342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.788622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.788900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.789617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.791042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:57:59.792390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.common [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 15:57:59.806869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 15:57:59.806869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 15:57:59.806869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [parameters: {'user_id': 'b9cf1896341e4501bb80b070d7997a19', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 15:57:59.806869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:59.815262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:59.816159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 15:57:59.817293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 15:57:59.818206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 15:57:59.819158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 15:57:59.820729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9cf1896341e4501bb80b070d7997a19', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:57:59.822204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 15:57:59.823655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:57:59.825731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 498/977] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Jun 29 15:57:59 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:57:59.833805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:57:59.895735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:57:59.941318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec20d5-c6c2-4ce6-8505-aecb22edd570 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:57:59.980717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:57:59.981927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:57:59.982419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:57:59.982897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:57:59.991491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:57:59.993233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8668d865-eaec-4b69-a21b-f52a33789c28 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:58:00.009063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:00.010076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 15:58:00.011033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:00.017694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 480/978] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:57:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:00.021152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:00.064611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:00.141203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d650-25b5-4c4d-940e-625256742c7e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:00.176620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:00.177626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:00.178114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:00.178565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:00.179562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:00.180094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:00.181897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551fb47-7154-4903-8fc1-864a3c9ca084 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:00.221599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 499/979] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Jun 29 15:58:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:00.231287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6b53-6426-4183-9fbf-61d55345ae00 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:00.231568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6b53-6426-4183-9fbf-61d55345ae00 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:00.231889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6b53-6426-4183-9fbf-61d55345ae00 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:00.233663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 481/980] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:00.239429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4329b-7480-49b1-be91-ff8bd36ce1b0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:00.239994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4329b-7480-49b1-be91-ff8bd36ce1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:00.240442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4329b-7480-49b1-be91-ff8bd36ce1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:00.258907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-62f4329b-7480-49b1-be91-ff8bd36ce1b0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:00.260864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62f4329b-7480-49b1-be91-ff8bd36ce1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:00.340142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 500/981] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:00.363735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6b53-6426-4183-9fbf-61d55345ae00 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:00.476598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6b53-6426-4183-9fbf-61d55345ae00 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:00.495931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:00.514219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:00.514812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:00.515097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:00.515375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:00.516313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:00.518241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c0851-3a2c-4716-aee5-9e75366f0289 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:00.533654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 482/982] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:58:00 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:01.627246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00536-b372-4f77-9d26-62a78901d8ad None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.627793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00536-b372-4f77-9d26-62a78901d8ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.627793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e00536-b372-4f77-9d26-62a78901d8ad None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.629357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 501/983] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:01.634735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.635232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.635306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.652915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:01.654106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:01.690407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278ecf-6f45-4976-914e-aac21be63d5a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.690912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278ecf-6f45-4976-914e-aac21be63d5a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.691342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278ecf-6f45-4976-914e-aac21be63d5a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.693061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 502/984] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:01.699020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.699315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.699597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.716455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:01.717657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:01.737229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 483/985] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:01.742360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:01.759943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:01.795217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 503/986] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:01.817536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:01.867611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d00a-a7bf-4318-9896-9cf5f9996ea3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:01.870694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:01.905450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:01.906184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.906465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.906737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.907386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:01.909324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:01.920893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd50782-61f7-4119-9e4f-b1e413856c9d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:01.921236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:01.922224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:01.923110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 484/987] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:58:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:01.930674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:01.958170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:01.959066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:01.959344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:01.959612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:01.960288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:01.961851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:01.975845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:01.976893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:01.977728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 504/988] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jun 29 15:58:01 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:01.983005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.006347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:02.038105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dbd35-1dbc-4d2d-8f40-ab92dd9ec243 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.071132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.071794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.072103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.072378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.073086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:02.073392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.075213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.088431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 485/989] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:58:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:02.093579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.102513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8087b-76f9-4f27-91b0-a577006ac016 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.127393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:02.139548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.140266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.140553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.140830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.141594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:02.142620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.143875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.149260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 505/990] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:02.154361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.206248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd3e0a-2d40-4a6c-aaa0-9bb442e003f7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.241257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.241924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.242205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.242476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.243181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:02.243486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.244890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.250026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 486/991] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:02.250776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:02.257226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.273524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f43c0e-e90a-49fb-927f-22a6675846cf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.306800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.307590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.307894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.308180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.308888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:02.309197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.310554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.315599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 506/992] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:02.368146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:02.376864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1da9d-0a6f-465f-9408-dce9c48d6fca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.413209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.413885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.414165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.414439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.415247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] RBAC: Adding query filter params (interface=admin, service_id=44b1afaabb7c415bb58c523ae034fbc1, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:02.415558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.416991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b9c3-768c-4077-8b23-a9952ef31bf6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.423024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 487/993] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/endpoints?service_id=44b1afaabb7c415bb58c523ae034fbc1&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:02.429155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.535228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d283c2-4960-43bf-9b94-07e2015f9a85 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.570187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.570846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.571122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.571390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.572092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.573443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.574719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2fcf-5234-4b42-9e4f-f7f0fb79f456 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.575002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2fcf-5234-4b42-9e4f-f7f0fb79f456 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.575294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2fcf-5234-4b42-9e4f-f7f0fb79f456 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.576838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 488/994] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:02.580518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 507/995] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 15:58:02.581439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.581731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.582012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.600010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:02.601254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:02.686015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 489/996] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:02.709550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:02.726416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:02.834802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb5f2-c3d1-42f9-8a03-0c706f1eeea2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:02.881631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:02.882507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:02.883018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:02.883506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:02.884709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:02.886586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:02.903116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:02.904435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:02.905585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:02.908137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 508/997] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:02.913271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:03.020288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:03.033830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89abf2-07e5-4da1-816f-d3918e556da2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:03.078413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:03.080172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:03.080969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:03.082311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:03.083679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:03.084312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:03.086647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:03.101149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 490/998] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:58:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:03.102490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:03.207594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:03.239724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0267-13c4-4629-839d-aec207e0c0d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:03.284560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:03.285226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:03.285514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:03.285791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:03.286501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:03.286808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:03.288207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:03.300598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 509/999] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:58:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:03.304871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:03.413125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171141-46cb-4f46-af30-c586d595a944 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:03.449098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:03.449830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:03.450116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:03.450389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:03.451203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] RBAC: Adding query filter params (interface=public, service_id=28fe11303d7b42af995b0658e9f849be, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:03.451517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:03.452958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471be7-166a-44a0-a812-61a4dd2cd02a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:03.463854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 491/1000] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:58:03 2022] GET /identity/v3/endpoints?service_id=28fe11303d7b42af995b0658e9f849be&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:03.465710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:03.569719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15c47-5b51-4f62-a890-5e07dbc57097 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:03.602878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:03.603538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:03.603944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:03.604134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:03.604950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:03.606545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8818b6f-64f1-4c02-912b-6efa56103538 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:03.620186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 510/1001] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:58:03 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 15:58:04.375520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a07f-7f76-4b73-bf8f-a5227a7c9ee5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.376030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a07f-7f76-4b73-bf8f-a5227a7c9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.376030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a07f-7f76-4b73-bf8f-a5227a7c9ee5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.377678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 492/1002] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:04.382521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae33c-737b-4bb6-bab4-8cd135737e9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.382911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae33c-737b-4bb6-bab4-8cd135737e9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.383085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fae33c-737b-4bb6-bab4-8cd135737e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.388934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:04.400810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1fae33c-737b-4bb6-bab4-8cd135737e9f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:04.401982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1fae33c-737b-4bb6-bab4-8cd135737e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:04.466587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 511/1003] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:04.489931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a07f-7f76-4b73-bf8f-a5227a7c9ee5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:04.509753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:04.592659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a07f-7f76-4b73-bf8f-a5227a7c9ee5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:04.626980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:04.627557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.627846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.628127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.628847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:04.630207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497f00-ee19-40aa-bdba-8afb8eeaa91f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:04.644328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 493/1004] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:58:04 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:04.685233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260dcd-bd2a-4800-91ba-03966af0d9ae None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.685525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260dcd-bd2a-4800-91ba-03966af0d9ae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.685805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa260dcd-bd2a-4800-91ba-03966af0d9ae None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.687374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 512/1005] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:04.693243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.693597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.693814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.712107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:04.713342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:04.798758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 494/1006] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:04 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:04.821211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa260dcd-bd2a-4800-91ba-03966af0d9ae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:04.925712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa260dcd-bd2a-4800-91ba-03966af0d9ae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:04.958853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:04.959652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:04.959965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:04.960242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:04.960892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:04.962243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:04.964017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:04.976345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:04.977472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:04.978333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 513/1007] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Jun 29 15:58:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:04.983695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:04.986896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:05.087166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ceacc-4a60-49b1-b5b8-da79769ffedc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:05.121290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:05.121954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.122233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.122503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.123198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:05.123497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:05.124882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:05.131867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 495/1008] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:58:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:05.136053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:05.238126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbac-8490-4934-9737-ba3c4cb59f57 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:05.271922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:05.272590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.272927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.273206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.273936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:05.274252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:05.275606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf17e7-5ec2-4f81-b969-7bde42686fc2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:05.280652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 514/1009] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Jun 29 15:58:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:05.286161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:05.353456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:05.389512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90ba9-83fe-4435-833f-dfb0661d63fd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:05.424737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:05.425400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.425687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.425965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.426715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:05.428118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301febc5-358f-424a-bb33-fcd13a6de524 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:05.445392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 496/1010] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:58:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:05.690384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12e3e-3e18-41bc-9592-ee64a53b7377 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.690871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12e3e-3e18-41bc-9592-ee64a53b7377 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.690871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12e3e-3e18-41bc-9592-ee64a53b7377 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.692390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 515/1011] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:05.697484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.697784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.698067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.715232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:05.716447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:05.794923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 497/1012] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:05 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:05.819212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12e3e-3e18-41bc-9592-ee64a53b7377 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:05.881590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:05.923196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12e3e-3e18-41bc-9592-ee64a53b7377 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:05.960035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:05.960757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:05.961044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:05.961323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:05.961976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:05.963338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:05.975301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:05.976388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:05.982256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 516/1013] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:58:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:05.983074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:06.039338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:06.094627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0c3b9-3ac1-4442-a8df-c313952e66b4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:06.129277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:06.129931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:06.130209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:06.130478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:06.131173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:06.131473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:06.133185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:06.138224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 498/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:58:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:06.144338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:06.244479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b472a-0caf-442e-ac40-b1384fab70fc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:06.269281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:06.278694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:06.279349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:06.279629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:06.279930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:06.280627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:06.280933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:06.282284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2944ea-f969-4c59-a7f8-e6e8b08105e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:06.287355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 517/1015] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Jun 29 15:58:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:06.292768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:06.395996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d0223-84db-4ed1-8782-d88696c451d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:06.412941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:06.431407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:06.432091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:06.432362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:06.432637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:06.433379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:06.434761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37d099-685b-46bc-b52c-b6ae53b8ac2a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:06.454565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 499/1016] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:58:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:06.748775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821db6-5af2-40d3-b9fb-83e90529a6d0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:06.749276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821db6-5af2-40d3-b9fb-83e90529a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:06.749352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09821db6-5af2-40d3-b9fb-83e90529a6d0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:06.750847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 518/1017] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:06.755974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:06.756272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:06.756551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:06.773215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:06.774396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:06.849196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 500/1018] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:06.872589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09821db6-5af2-40d3-b9fb-83e90529a6d0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:06.976021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09821db6-5af2-40d3-b9fb-83e90529a6d0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.009382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.010160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.010440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.010711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.011357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.013316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:07.025573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:07.026703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:07.027543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 519/1019] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jun 29 15:58:06 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:07.033427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.139263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:07.143614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c15b2c-b370-47f5-83fd-51bfe4005eed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.178509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.179177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.179460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.179734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.180472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] RBAC: Adding query filter params (name=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:07.180776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.182142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.187228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 501/1020] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:07.192836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.249586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:07.295735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714481ce-8022-4b1c-995b-5f27c4c4e04d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.328815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.330033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.330315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.330590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.331292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:07.331598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.332983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dfc84-484e-4480-b795-d556af3db8dd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.342585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 520/1021] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:07.343786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.446461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf114-94a6-48a5-b978-af74bd1f871b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.481234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.481894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.482180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.482456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.483490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] RBAC: Adding query filter params (interface=public, service_id=2770423469ab4c66aa45fccd710004ca, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:07.483815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.485219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.485558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b0b3-cece-4a1e-ab16-042d4631d899 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.485838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b0b3-cece-4a1e-ab16-042d4631d899 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.486118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b0b3-cece-4a1e-ab16-042d4631d899 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.487759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 521/1022] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:58:07.491185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 502/1023] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 15:58:07 2022] GET /identity/v3/endpoints?service_id=2770423469ab4c66aa45fccd710004ca&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:07.492561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.492847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.493123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.495741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.513830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:07.515322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:07.524007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:07.598392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa20ef-c941-4728-8334-fbb58160b167 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.608149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 522/1024] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:07.622295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.634538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.635199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.635483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.635756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.636461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.637815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.645819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 503/1025] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 15:58:07 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 15:58:07.679424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:07.737308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5cb1-a4ab-4ebf-8966-fa8a5a9f470d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.773938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.774767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.775097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.775372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.776698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.778157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a517-9211-4d7e-9cc6-9cdb6bb98abc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.780058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 523/1026] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:07.786414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:07.886299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:07.896443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009cbf-d479-4139-94bc-a84a257faf05 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:07.931293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:07.931983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:07.932272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:07.932550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:07.933769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:07.935275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2df7-6ea5-481d-a617-ad02f37dca9f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:07.971850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 504/1027] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:58:07 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:08.601951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fa9e-f488-4742-935e-b02b5ba07fb4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:08.602327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fa9e-f488-4742-935e-b02b5ba07fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:08.602525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26fa9e-f488-4742-935e-b02b5ba07fb4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:08.604033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 524/1028] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:08.609346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:08.609793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:08.609954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:08.627531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:08.628756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:08.696991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 505/1029] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:08.720079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26fa9e-f488-4742-935e-b02b5ba07fb4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:08.834078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26fa9e-f488-4742-935e-b02b5ba07fb4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:08.850775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:08.869950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:08.870693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:08.870977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:08.871255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:08.881252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:08.889487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:08.890390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:08.891236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 525/1030] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:58:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:08.896709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:08.969449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:08.997764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe60d-32f1-4490-b37d-389d856680ae None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.031801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.032996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.033270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.033536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.034278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:09.034583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.036014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.049454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 506/1031] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:58:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:09.050980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.162433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e9f0-cc78-4f41-a0f6-a856315e38a1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.195139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.195958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.196237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.196510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.207487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.208956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:09.226137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:09.227046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:09.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:09.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:09.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:09.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:09.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 526/1032] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:09.234642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.333753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f0391-bc26-49d2-aa0f-052f517c44e0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.366870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.367525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.367806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.368107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.368818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:09.369119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.370475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.372772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:09.383866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 507/1033] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:09.389233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.418295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:09.490982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1d11-9ae9-4923-949c-e355a59ac5f8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.523667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.524483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.524762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.525034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.532447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.534357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b9d358c4-05f0-4b3b-a6c1-2efcd0ee5c40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:58:09.548146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:09.549081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:09.550030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:09.551488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 527/1034] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:09.554950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.657503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408432f-ef13-4cdf-b57a-78deaa0dfd68 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.691461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.692087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.692372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.692645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.693472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:09.693783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.695206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.705782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea658d-6143-4017-80ab-5a5ed71fa015 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.706074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea658d-6143-4017-80ab-5a5ed71fa015 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.706356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea658d-6143-4017-80ab-5a5ed71fa015 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.707887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 528/1035] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:09.712635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.712926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.713209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.718259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 508/1036] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:09.720200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.731238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:09.732802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:09.780846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:09.806423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 529/1037] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:09.830533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:09.835468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e1225-fe38-4516-b978-fe537cb21b52 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.850779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:09.874876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.875526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.875809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.876637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.937759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3039-bfb1-46a9-9dad-09f7127fab32 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:09.949288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.950675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7acddb-5b2e-4218-9dc5-204b3a700929 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.973965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:09.974759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:09.975040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:09.975315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] PATH_INFO: `/v3/services/image` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:09.976003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:09.977355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:09.989883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:09.990906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:09.991759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 530/1038] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:09.997220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.015939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.061216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 509/1039] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 15:58:10.062380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f710-a74a-4872-855f-d2928257b740 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.062667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f710-a74a-4872-855f-d2928257b740 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.062945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f710-a74a-4872-855f-d2928257b740 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.067951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 510/1040] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:10.068869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f710-a74a-4872-855f-d2928257b740 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.087058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.105682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d58ca-dcda-4656-bb96-772454ba3121 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.138693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.139346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.139626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.139929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.140627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:10.140932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.142303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581abde9-c0c0-4e11-ad86-e07cf08b283a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.146947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 531/1041] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:10.148255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.148539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.148814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.164145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:10.165315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:10.177505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f710-a74a-4872-855f-d2928257b740 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.211244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.211992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.212276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.212551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.222736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.224334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.230641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 532/1042] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:10.231453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:10.242659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:10.243588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:10.244518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:10.244518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:10.244518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:10.244518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:10.244518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 511/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:10.249565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.261994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.311491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.334111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f41969-f367-4f9d-9da6-18fe73cd8350 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.352807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4474f-a1f0-4c1f-8b3f-9d4b0b4c6303 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.368854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.369511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.369792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.370068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.370771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] RBAC: Adding query filter params (type=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:10.371079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.372480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.381870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 533/1044] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:10.381870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.386461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.387118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.387398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.387675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.388422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:10.388722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.390075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.401083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 512/1045] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:10.401822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.466189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.477663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde72d4-e1c8-4e78-a3f8-5bab0a7dc42c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.501321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba35cf-1c31-4865-b00d-adaf7458f409 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.510959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.511744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.512056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.512330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.513489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.514898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.516564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 534/1046] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:10.517317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.527517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.534959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.535615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.535929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.536206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.536934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.538303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.556147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 513/1047] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 15:58:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:10.556912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.625410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7473-6db1-41c5-8c4c-daaedce61e48 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.672779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.674172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.674455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.674729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.676154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a3d4-5084-4d85-84ca-a83a7a1a9ee9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.682661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.684300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:58:10.700136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:10.701132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:10.702570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:10.703130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.703207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 535/1048] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:10.707919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.720966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.721638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.721926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.722202 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.722919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.724476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.750465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 514/1049] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:58:10 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:10.776326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:10.820821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a539806-07b3-440b-81e0-cd7c00530a77 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:10.857552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:10.858205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:10.858757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:10.859029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:10.859850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:10.860163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:10.861680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f866f-0cb7-4f1e-913b-4753924cf56f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:10.875844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 536/1050] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:10.882609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:10.992340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c434-9a91-4f29-9e7f-0f7247f15a13 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:11.025745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:11.026402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:11.026677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:11.026945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:11.027771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] RBAC: Adding query filter params (role.id=f58c56e61bb84fc489eefd6f7180dfc7, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:11.028107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:11.029536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d44a-3c21-477d-ba20-ad3197f62c38 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:11.035886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 515/1051] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:10 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=f58c56e61bb84fc489eefd6f7180dfc7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:12.633806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb0da-811e-4c9d-9bd9-784b4d53a858 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:12.634330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb0da-811e-4c9d-9bd9-784b4d53a858 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:12.634330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbb0da-811e-4c9d-9bd9-784b4d53a858 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:12.635744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 537/1052] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:12.640807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cfce-dd66-4215-bfb9-4fbd9d772638 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:12.641193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cfce-dd66-4215-bfb9-4fbd9d772638 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:12.641368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624cfce-dd66-4215-bfb9-4fbd9d772638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:12.658449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9624cfce-dd66-4215-bfb9-4fbd9d772638 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:12.659616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9624cfce-dd66-4215-bfb9-4fbd9d772638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:12.694233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:12.727848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 516/1053] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:12.750675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbb0da-811e-4c9d-9bd9-784b4d53a858 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:12.851942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbb0da-811e-4c9d-9bd9-784b4d53a858 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:12.875695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:12.879405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075596fb-f8e6-4de1-aa9c-c55ed8c2178e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:12.879697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075596fb-f8e6-4de1-aa9c-c55ed8c2178e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:12.880015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075596fb-f8e6-4de1-aa9c-c55ed8c2178e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:12.881500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 517/1054] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:58:12.886363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:12.886587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:12.886859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:12.892988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:12.893646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:12.893928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:12.894206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:12.903973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:12.905233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:12.966634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:12.968106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94cb9d-2c15-4511-8a92-509026c8c5b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:12.974026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 518/1055] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:12.997383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.077581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 538/1056] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:13.077581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6115e0-7745-43f9-a92e-3232c58a58f8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.077581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6115e0-7745-43f9-a92e-3232c58a58f8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.077581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6115e0-7745-43f9-a92e-3232c58a58f8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.078669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 539/1057] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:13.081348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6115e0-7745-43f9-a92e-3232c58a58f8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.103794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed36ae-f99f-4505-8651-b9ab0cf6d747 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.105340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.106513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.138896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.139634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.139946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.140215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.150956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a3630b11-daf7-4f0f-bfb4-256841e78586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:13.159240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:13.160287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:13.161134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 519/1058] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:13.161831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.161898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.162141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.178015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:13.179203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:13.186248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6115e0-7745-43f9-a92e-3232c58a58f8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.219167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.220543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.220831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.221102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.230962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.232422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.245663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 520/1059] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:13.246465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:13.250234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:13.251123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:13.252099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:13.252099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:13.252099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:13.252099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:13.252099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 540/1060] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:13.265202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.341224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.343700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.352902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785ddfe-86f6-4a4d-bd6c-8a19db11279c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.364119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87dd3f-6006-4358-9e0d-f585e0bc1403 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.386238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.386906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.387191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.387466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.388250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:13.388561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.389988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.398399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 521/1061] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:13.398522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.399148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.399263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.399501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.399701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.400457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:13.400765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.402108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.413916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 541/1062] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:13.414708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.525137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8e7ab-3d9a-4f1c-9ad0-f53e91d4409a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.525351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4ea13-1f33-4570-952e-aeffeabffe32 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.560297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.561182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.561458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.561576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.561730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] PATH_INFO: `/v3/users/ec28f0a52a2748fe93f539287906ab7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.562278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.562553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.562827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.566403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.577466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:13.580496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] RBAC: Authorizing `identity:get_user(user_id=ec28f0a52a2748fe93f539287906ab7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.581949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.583877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 542/1063] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/users/ec28f0a52a2748fe93f539287906ab7b => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:13.587180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:13.588454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:13.589706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 522/1064] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:13.591472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.594225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.610533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.708164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531653de-d3f6-4a19-9cd5-fcec19fd82b2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.709482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689f6ec-7e34-415e-9f6e-d54dc0dc4eee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.742115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.742757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.743040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.743316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.743545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.744245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.744530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.744805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.745551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:13.745861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.747227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.755596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 523/1065] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:13.761147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.805721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.813408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.815406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.838887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:13.861858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4908f-c911-4ace-b7d0-2dc50136b4e9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:13.895007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:13.895786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:13.896100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:13.896363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:13.906520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:13.908024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:13.916945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 543/1066] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:13.922839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:13.925690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:13.926549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:13.927439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:13.927439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:13.927439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:13.927439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:13.927439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 524/1067] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:13.932628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.014377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.027612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76e2f3-e3fe-43e3-b6ac-66a861aafa57 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.031526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3847e-e79e-4572-b217-f479c42a3e5a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.057125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.062412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.063376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.064336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.064773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.065930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.066110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.066769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.067053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.067334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.067421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.068100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:14.068407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.069058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 544/1068] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:14.069768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.075007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.082944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 525/1069] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:14.089141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.174227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35bce-f2ce-4e3f-bc0f-afa4e6672436 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.189009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e884d3-2e85-4780-a0db-1efaeee7212a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.206993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.207643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.207954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.208233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.209068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=a0d3bc58f41f42d78345e9c1c053076c, user.id=ec28f0a52a2748fe93f539287906ab7b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:14.209388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.210811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.216361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 545/1070] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/role_assignments?user.id=ec28f0a52a2748fe93f539287906ab7b&scope.project.id=a0d3bc58f41f42d78345e9c1c053076c&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:14.222423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.223235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.223517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.223790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.232261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.234022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:58:14.250652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:14.251876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:14.258041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 526/1071] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:14.258862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.287318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.362198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c6c0-cfa6-490f-8488-0ede08488361 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.395241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.395939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.396221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.396497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.397328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:14.397639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.399054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.416111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 546/1072] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:14.421626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.470487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.520513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867022b3-bf84-4158-911a-d4060378bbe4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.554091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.554872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.555154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.555427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.565295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.566731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:14.584243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:14.585199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:14.586191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:14.586191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:14.586191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:14.586191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:14.586191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 527/1073] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:14.591126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.673770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.690042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877823-63f6-4f18-8809-14080b64a748 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.723604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.724279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.724557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.724831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.725542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:14.725845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.727181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.738409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 547/1074] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:14.743874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:14.837917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:14.840805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067e9e-dffd-43bd-a74f-14b1a93786a0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:14.874201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347c871-9900-4242-a361-978454232cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:14.874985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347c871-9900-4242-a361-978454232cbb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:14.875268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347c871-9900-4242-a361-978454232cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:14.875537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347c871-9900-4242-a361-978454232cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:14.882681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347c871-9900-4242-a361-978454232cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:14.884140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347c871-9900-4242-a361-978454232cbb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4347c871-9900-4242-a361-978454232cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:58:14.898025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:14.899077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:14.900031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 528/1075] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:14.904909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:15.000423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea202-d172-4b5d-8505-821a394eb055 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:15.033186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:15.033825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:15.034106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:15.034381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:15.035160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:15.035468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:15.036909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782f2fd-4f6c-4398-9dcf-00bcf514b5b6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:15.049065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 548/1076] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:15.054875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347c871-9900-4242-a361-978454232cbb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:15.159175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347c871-9900-4242-a361-978454232cbb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:15.192292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:15.193173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:15.193453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:15.193726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/f58c56e61bb84fc489eefd6f7180dfc7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:15.195923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=34be797ec47b4d66aba7a9fa13419dd6, role_id=f58c56e61bb84fc489eefd6f7180dfc7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:15.197352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270c929-068c-4e3e-bbcf-1929d8ff6501 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:15.210388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 529/1077] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:58:15 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/34be797ec47b4d66aba7a9fa13419dd6/roles/f58c56e61bb84fc489eefd6f7180dfc7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 15:58:16.238802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313e39-9a7b-4c9e-85a8-d516796134ad None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.239321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313e39-9a7b-4c9e-85a8-d516796134ad None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.239406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da313e39-9a7b-4c9e-85a8-d516796134ad None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.240897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 549/1078] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:16.246103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.246546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.246640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.263040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:16.264233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:16.278358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:16.335201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 530/1079] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:16.357677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da313e39-9a7b-4c9e-85a8-d516796134ad None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:16.361624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:16.455233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da313e39-9a7b-4c9e-85a8-d516796134ad None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:16.486862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:16.487635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.487943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.488212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.497825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:16.505931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:16.506866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:16.507705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 550/1080] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:16.513213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:16.609086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e0ada-b301-432b-ae38-3e9b9a60b747 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:16.642350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:16.643022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.643306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.643581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.644355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:16.644663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:16.646029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:16.654108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 531/1081] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:16.659881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:16.723050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:16.761284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484e529-94df-40bc-bbe2-25820e1beb1e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:16.794976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:16.795970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.796383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.796738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] PATH_INFO: `/v3/users/ec28f0a52a2748fe93f539287906ab7b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.797914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] RBAC: Authorizing `identity:get_user(user_id=ec28f0a52a2748fe93f539287906ab7b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:16.799363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:16.801032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 551/1082] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:16 2022] GET /identity/v3/users/ec28f0a52a2748fe93f539287906ab7b => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:16.806822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:16.822034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:16.906097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427f8e1-1ff8-4b50-acda-da0604a06d19 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:16.938804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:16.939663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:16.939976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:16.940253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:16.941423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:16.942853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e906c-e8da-4085-a9bb-6b05026c2e73 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:16.944578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 532/1083] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:16 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:16.950334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:17.047839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d52f1-05b0-47ba-b9b9-288d8f8b2abf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:17.077535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:17.084793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:17.085707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.085993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.086271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c/users/ec28f0a52a2748fe93f539287906ab7b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.088299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d3bc58f41f42d78345e9c1c053076c, user_id=ec28f0a52a2748fe93f539287906ab7b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:17.089738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dc6d7-1d31-49f1-8394-1b00dd35a46b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:17.102602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 552/1084] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:58:16 2022] PUT /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c/users/ec28f0a52a2748fe93f539287906ab7b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 15:58:17.227769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ce07-9fa8-43fa-a269-ffd9b7b306ed None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.228016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ce07-9fa8-43fa-a269-ffd9b7b306ed None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.228294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ce07-9fa8-43fa-a269-ffd9b7b306ed None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.229830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 533/1085] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:17.235752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.236075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.236356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.254676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:17.255911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:17.321404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 553/1086] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:17.345390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558ce07-9fa8-43fa-a269-ffd9b7b306ed None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:17.426096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:17.446922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558ce07-9fa8-43fa-a269-ffd9b7b306ed None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:17.478973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:17.479726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.480038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.480315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.491421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:17.499588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:17.500834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 15:58:17.502702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:17.503963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 534/1087] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Jun 29 15:58:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:17.507266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:17.602892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3235-20d8-4b89-9a93-57d1a860e275 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:17.625698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:17.638805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:17.639468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.639753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.640057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.640806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:17.641115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:17.642472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:17.650553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 554/1088] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:58:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:17.656122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:17.753049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6c536-0efb-4790-8a7b-08799400980d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:17.785373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:17.786160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.786441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.786713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.794843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:17.797011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:17.799112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:17.817459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:17.818358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:17.819263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:17.819263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:17.819263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:17.819263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:17.819263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 535/1089] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:17.824494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:17.925556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db1408-b561-4002-b203-7e73afab4191 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:17.957158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:17.957808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:17.958092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:17.958367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:17.959088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:17.959399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:17.960875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:17.972767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 555/1090] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:17.978343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:18.078384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c553cd-15ce-4b2b-9857-2d413452aba0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:18.112616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:18.113407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:18.113689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:18.113966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:18.122269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:18.123712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 15:58:18.137542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:18.138562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:18.139519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 536/1091] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Jun 29 15:58:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:18.144473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:18.190765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:18.245613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2dba-24f2-4dbb-8f4b-6da88241122c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:18.278448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:18.279117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:18.279401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:18.279678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:18.280540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:18.280852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:18.282267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:18.299412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 556/1092] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Jun 29 15:58:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:18.304900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:18.357192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:18.406956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68480535-fb6c-4c2f-87cd-ccb0a4663548 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:18.440954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:18.441596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:18.441878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:18.442153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:18.507997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:18.509442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:18.559373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:18.612297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 537/1093] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 15:58:18.613361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:18.711695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dc021-e079-40c5-afcb-dac72b525750 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:18.713256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:18.746552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:18.747342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:18.747624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:18.747933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:18.759150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:18.760603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:18.778480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:18.779532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:18.780497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:58:18.780497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:18.780497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:58:18.780497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:18.780497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 557/1094] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:18.785317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:18.882103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570745-95b9-4335-a627-5e35a4c91307 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:18.915123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:18.915774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:18.916084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:18.916359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:18.917076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:18.917381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:18.918748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:18.930208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 538/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:18.935805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.036716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168021f7-f75a-4053-b0b3-bac5bb8cf8da None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.069256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.070042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.070323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.070596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.077181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.078620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-13786d56-25c5-42d1-83cb-3943f0bb2058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 15:58:19.092954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:19.094015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 15:58:19.095759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:19.100113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 558/1096] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 15:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:19.101529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.117677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:19.119138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3f981-fee2-4d6d-871e-cba46ddf2364 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.119468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3f981-fee2-4d6d-871e-cba46ddf2364 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.119918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3f981-fee2-4d6d-871e-cba46ddf2364 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.121285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 559/1097] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 15:58:19.126096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.126382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.126662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.143468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:19.144660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:19.153765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:19.205553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f030-81dc-48ef-9525-b01a1ec751a7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.213099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 560/1098] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:19.237496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.239750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.240517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.240794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.241062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.241842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:19.242146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.243573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:19.255525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 539/1099] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:19.264534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.340630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88299f-c1dc-4e1f-ad69-6b3bec98c475 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.341141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:19.377365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f9c-2405-43ca-8860-33cc52a217fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.382381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.383274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.383632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.384004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.397665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:19.407990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:19.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:19.409752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 561/1100] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 15:58:19.413837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.414552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.414901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.415243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.415718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.416245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] RBAC: Adding query filter params (role.id=f58c56e61bb84fc489eefd6f7180dfc7, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=34be797ec47b4d66aba7a9fa13419dd6) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:19.416619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.418115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:19.419864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:19.425702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 540/1101] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/role_assignments?user.id=34be797ec47b4d66aba7a9fa13419dd6&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=f58c56e61bb84fc489eefd6f7180dfc7 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:19.529476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba076c8-ab20-4be6-903f-394b4daed2b0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.564816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.565492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.565771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.566041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.566793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:19.567104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.568483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:19.579163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 562/1102] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:19.585775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.698641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564bc3f-26b1-4d96-bd8e-7a75c6022ab4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.731852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.732731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.733007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.733277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] PATH_INFO: `/v3/users/ec28f0a52a2748fe93f539287906ab7b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.734719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] RBAC: Authorizing `identity:get_user(user_id=ec28f0a52a2748fe93f539287906ab7b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.736698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:19.738305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 541/1103] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/users/ec28f0a52a2748fe93f539287906ab7b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:19.744196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:19.811281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:19.847308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c92b62-4bea-42ab-84fd-fb71bff45f28 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:19.882112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:19.883070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:19.883070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:19.883284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:19.954534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:19.955937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:20.020611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:20.056670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 563/1104] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:20.062704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:20.067075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:20.170254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee04bf-8194-4acc-ad20-0badc70f2f49 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:20.204152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:20.205065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:20.205299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:20.205573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:20.206758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:20.208231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa663d-876d-4e5e-8eea-b7ae7798d9e3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:20.209926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 542/1105] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:20 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:20.216164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:20.323439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cef6-6a1e-4f05-8590-2ac8dad69acb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:20.356076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:20.356713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:20.356990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:20.357261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:20.358074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=a0d3bc58f41f42d78345e9c1c053076c, user.id=ec28f0a52a2748fe93f539287906ab7b) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:20.358383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:20.360073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b26b6f-5f7b-4fd5-98c8-509bb079f476 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:20.366432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 564/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:20 2022] GET /identity/v3/role_assignments?user.id=ec28f0a52a2748fe93f539287906ab7b&scope.project.id=a0d3bc58f41f42d78345e9c1c053076c&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:22.428644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d670-8540-415b-a6a8-dab78b4a8fdc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:22.429154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d670-8540-415b-a6a8-dab78b4a8fdc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:22.429154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57d670-8540-415b-a6a8-dab78b4a8fdc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:22.430473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 543/1107] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:22.435487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:22.435920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:22.436078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:22.452628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:22.453791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:22.477385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:22.519633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 565/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:22.544675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57d670-8540-415b-a6a8-dab78b4a8fdc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:22.613237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:22.641826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57d670-8540-415b-a6a8-dab78b4a8fdc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:22.674715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:22.675487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:22.675770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:22.676072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:22.677234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:22.678700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487e790-8062-4499-8317-fc94090cad6b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:22.680265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 544/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:22.685775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:22.779049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d790bd2-3a4c-4c84-9aec-3072d8f0e738 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:22.812189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:22.812841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:22.813127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:22.813404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:22.814149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:22.815551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274281-ad96-43d5-8313-bc62a835f613 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:22.834701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 566/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:58:22 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:24.856585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c13-b8ae-4688-b078-4cf97ee5c6a0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:24.857112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c13-b8ae-4688-b078-4cf97ee5c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:24.857112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c13-b8ae-4688-b078-4cf97ee5c6a0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:24.858488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 545/1111] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:24.864340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:24.864711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:24.864902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:24.881052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:24.882222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:24.892419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:24.946456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 567/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:24.971063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409c13-b8ae-4688-b078-4cf97ee5c6a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:25.071474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409c13-b8ae-4688-b078-4cf97ee5c6a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:25.105174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:25.106024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:25.106304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:25.106578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] PATH_INFO: `/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:25.108119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] RBAC: Authorizing `identity:get_role(role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:25.109694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:25.111068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 546/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:24 2022] GET /identity/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:25.116933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:25.210631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12bf4e-d05c-49de-8bd9-38be595eafc4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:25.243126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:25.244003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:25.244283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:25.244554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] PATH_INFO: `/v3/users/386111e35e5741f8b53cf615b94d5544` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:25.256904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] RBAC: Authorizing `identity:get_user(user_id=386111e35e5741f8b53cf615b94d5544)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:25.258316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:25.260094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 568/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:25 2022] GET /identity/v3/users/386111e35e5741f8b53cf615b94d5544 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:25.265650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:25.276753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:25.363439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e59ac-0772-44fd-9ed1-8584deff7d50 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:25.396899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:25.397532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:25.397815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:25.398089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:25.466357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:25.467793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:25.477733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:25.564162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 547/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 15:58:25.570269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:25.574027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:25.665523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe632c-0846-403e-9a16-25559423d67b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:25.698603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:25.699445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:25.699731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:25.700039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:25.701205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:25.702618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670edfc7-3568-4f4c-8753-f84da06503ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:25.704413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 569/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:25 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:25.710335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:25.808375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534a15-f2cb-400f-aa19-6a0ec94d9bd1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:25.817908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:25.841735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:25.842372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:25.842656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:25.842925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:25.843734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=a0d3bc58f41f42d78345e9c1c053076c, user.id=386111e35e5741f8b53cf615b94d5544) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:25.844069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:25.845549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a912e-d25e-477a-85fc-d7e391b4b3c5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:25.850715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 548/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:25 2022] GET /identity/v3/role_assignments?user.id=386111e35e5741f8b53cf615b94d5544&scope.project.id=a0d3bc58f41f42d78345e9c1c053076c&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:27.814532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede1288-fd2f-4318-9120-ed591ac9c996 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:27.815068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede1288-fd2f-4318-9120-ed591ac9c996 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:27.815068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede1288-fd2f-4318-9120-ed591ac9c996 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:27.816464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 570/1118] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:27.821659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:27.822055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:27.822207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:27.838958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:27.840159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:27.903379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 549/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:27.925857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede1288-fd2f-4318-9120-ed591ac9c996 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:27.995333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:28.024419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede1288-fd2f-4318-9120-ed591ac9c996 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:28.056668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:28.057507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:28.057783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:28.058053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] PATH_INFO: `/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:28.059506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] RBAC: Authorizing `identity:get_role(role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:28.060888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:28.062244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 571/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:27 2022] GET /identity/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:28.068809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:28.162955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0686041-8ed0-49fd-8bb4-4280b2c5f508 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:28.164446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:28.196481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:28.197332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:28.197612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:28.197882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] PATH_INFO: `/v3/users/386111e35e5741f8b53cf615b94d5544` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:28.199041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] RBAC: Authorizing `identity:get_user(user_id=386111e35e5741f8b53cf615b94d5544)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:28.200489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:28.202081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 550/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:28 2022] GET /identity/v3/users/386111e35e5741f8b53cf615b94d5544 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:28.207934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:28.303893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aed8c9-e689-4687-91b3-5979e1692f9f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:28.336435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:28.337219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:28.337501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:28.337778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:28.338949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:28.340398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bacb9a-415f-41e5-822f-88371c6963d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:28.342069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 572/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:28 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:28.348740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:28.445905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978089d-ee93-439f-891d-8b38395ce764 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:28.478485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:28.479347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:28.479626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:28.479925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c/users/386111e35e5741f8b53cf615b94d5544/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:28.482077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0d3bc58f41f42d78345e9c1c053076c, user_id=386111e35e5741f8b53cf615b94d5544, role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:28.483494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff5fca-6673-4e7a-a919-42715795fae3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:28.498408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 551/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:58:28 2022] PUT /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c/users/386111e35e5741f8b53cf615b94d5544/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:58:30.496673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971b60-97c1-4d95-b447-897bb2178a2a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:30.497201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971b60-97c1-4d95-b447-897bb2178a2a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:30.497201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6971b60-97c1-4d95-b447-897bb2178a2a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:30.498583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 573/1124] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:30.503754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:30.504158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:30.504412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:30.521137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:30.522318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:30.545458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:30.588231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 552/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:30.611503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971b60-97c1-4d95-b447-897bb2178a2a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:30.622034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:30.710216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6971b60-97c1-4d95-b447-897bb2178a2a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:30.742937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:30.743773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:30.744081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:30.744357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] PATH_INFO: `/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:30.745807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] RBAC: Authorizing `identity:get_role(role_id=9bbbb72b7b2b41849f81d3e3890fb30f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:30.747205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:30.748531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 574/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:30 2022] GET /identity/v3/roles/9bbbb72b7b2b41849f81d3e3890fb30f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:30.754657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:30.855978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952690d7-882d-4d87-b1d5-1283e7c1cac9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:30.888818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:30.889670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:30.889948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:30.890219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] PATH_INFO: `/v3/users/386111e35e5741f8b53cf615b94d5544` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:30.891620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] RBAC: Authorizing `identity:get_user(user_id=386111e35e5741f8b53cf615b94d5544)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:30.893902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:30.895497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 553/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:30 2022] GET /identity/v3/users/386111e35e5741f8b53cf615b94d5544 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:30.901153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:30.974031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:30.996849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392b997-78ff-439f-a373-df2ecd94902c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:31.029019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:31.029590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:31.029869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:31.030145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:31.094796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:31.096288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:31.173714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:31.197373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 575/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:31.203231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:31.230266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:31.299673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fdeaf-3cdd-48c5-96e9-b0b748db82d4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:31.332207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:31.333049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:31.333330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:31.333605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] PATH_INFO: `/v3/projects/a0d3bc58f41f42d78345e9c1c053076c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:31.334759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] RBAC: Authorizing `identity:get_project(project_id=a0d3bc58f41f42d78345e9c1c053076c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:31.336212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074e347-f161-4daa-9fc2-71d04907fbf9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:31.337870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 554/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:31 2022] GET /identity/v3/projects/a0d3bc58f41f42d78345e9c1c053076c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:31.343968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:31.439340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f13af-bed7-47ef-928c-2d5749acdc77 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:31.472174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:31.472808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:31.473091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:31.473363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:31.474187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] RBAC: Adding query filter params (role.id=9bbbb72b7b2b41849f81d3e3890fb30f, scope.project.id=a0d3bc58f41f42d78345e9c1c053076c, user.id=386111e35e5741f8b53cf615b94d5544) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:31.474501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:31.475942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5d5cb-8102-4291-ae5c-9a79dde1dff4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:31.481569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 576/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:31 2022] GET /identity/v3/role_assignments?user.id=386111e35e5741f8b53cf615b94d5544&scope.project.id=a0d3bc58f41f42d78345e9c1c053076c&role.id=9bbbb72b7b2b41849f81d3e3890fb30f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:33.505653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54eac-e704-4cab-9731-aa65f59f5ff9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:33.506189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54eac-e704-4cab-9731-aa65f59f5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:33.506189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54eac-e704-4cab-9731-aa65f59f5ff9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:33.507565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 555/1131] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:33.512657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:33.513088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:33.513208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:33.529864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:33.531033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:33.563675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:33.597088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 577/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:33.620405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad54eac-e704-4cab-9731-aa65f59f5ff9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:33.711842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:33.718622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad54eac-e704-4cab-9731-aa65f59f5ff9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:33.750674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:33.752008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:33.752292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:33.752562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:33.753745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:33.755158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708fe7-0726-43af-b4a8-57451bc738c2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:33.756820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 556/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:33.762445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:33.857657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f154a-aeb6-4623-a77c-1b5dd174cdd4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:33.890339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:33.890977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:33.891253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:33.891522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:33.892894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:33.894300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160adec4-8daf-4881-ba92-13b53f6d0098 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:33.917867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 578/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:58:33 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:35.953033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9e3d-efb0-462c-b5cd-006d65cbecfc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:35.953560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9e3d-efb0-462c-b5cd-006d65cbecfc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:35.953560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9e3d-efb0-462c-b5cd-006d65cbecfc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:35.955558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 557/1135] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:35.960834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:35.961256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:35.961408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:35.978009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:35.979207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:35.995745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:36.045220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 579/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:36.070609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd9e3d-efb0-462c-b5cd-006d65cbecfc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:36.169057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd9e3d-efb0-462c-b5cd-006d65cbecfc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:36.204966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:36.205951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:36.206234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:36.206509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:36.207689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:36.209154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cba14-01c2-46fb-bcec-06475b0c10e1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:36.210761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 558/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:36.216523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:36.310807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa617dfe-4c54-49ce-8f57-a50bcfb7b3ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:36.343157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:36.343797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:36.344106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:36.344377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:36.345110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:36.346507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c9d3b-cf5e-4eee-8d27-4bffe67c0d93 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:36.366246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 580/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:58:36 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:38.428856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c31f9-7ec2-4048-95c0-262182d02951 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:38.429399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c31f9-7ec2-4048-95c0-262182d02951 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:38.429399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c31f9-7ec2-4048-95c0-262182d02951 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:38.430678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 559/1139] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:38.435863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:38.436291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:38.436422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:38.453175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:38.454354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:38.456283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:38.520087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 581/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:38.543219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c31f9-7ec2-4048-95c0-262182d02951 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:38.574269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:38.641890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c31f9-7ec2-4048-95c0-262182d02951 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:38.674169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:38.674940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:38.675220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:38.675492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:38.685271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:38.693405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:38.694565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:38.695852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 560/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:38.700394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:38.794051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c701-66ee-42d2-ad42-cd58fcf489d3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:38.826994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:38.827644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:38.827959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:38.828237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:38.829001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:38.829308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:38.830685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:38.835458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:38.839024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 582/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:38.844262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:38.933943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:38.942789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed86464-295d-44e5-a77f-cb883b6c0180 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:38.974987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:38.975867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:38.976157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:38.976434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] PATH_INFO: `/v3/users/2aa6001cb5cc4d308d52353f7e854b63` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:38.990603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] RBAC: Authorizing `identity:get_user(user_id=2aa6001cb5cc4d308d52353f7e854b63)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:38.992059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:38.993673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 561/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:38 2022] GET /identity/v3/users/2aa6001cb5cc4d308d52353f7e854b63 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:38.999251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:39.096519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281e305-28ff-46b7-8f1d-87d43a6878e2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:39.129643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:39.130273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:39.130551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:39.130821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:39.193479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:39.195879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:39.197872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:39.292349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 583/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:39.298328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:39.394818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2cb5-5bde-4f0c-870d-a7d338441a9f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:39.427663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:39.428535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:39.428819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:39.429096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] PATH_INFO: `/v3/projects/48a5211a7c944941b5e39e051e30b3fb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:39.430281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] RBAC: Authorizing `identity:get_project(project_id=48a5211a7c944941b5e39e051e30b3fb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:39.431715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2780de-697c-4bb4-a85c-964270000c9e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:39.433407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 562/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:39 2022] GET /identity/v3/projects/48a5211a7c944941b5e39e051e30b3fb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:39.439204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:39.531410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:39.534927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0302-ed5c-4385-b62d-681554ab591a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:39.567769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:39.568431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:39.568708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:39.568978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:39.569793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=48a5211a7c944941b5e39e051e30b3fb, user.id=2aa6001cb5cc4d308d52353f7e854b63) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:39.570102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:39.571511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e17f-2be3-4279-a941-b3a2d3fc1f3f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:39.576784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 584/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:39 2022] GET /identity/v3/role_assignments?user.id=2aa6001cb5cc4d308d52353f7e854b63&scope.project.id=48a5211a7c944941b5e39e051e30b3fb&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:41.565657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb94e0c-40f6-4d2f-9b4b-687b84294431 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:41.566210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb94e0c-40f6-4d2f-9b4b-687b84294431 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:41.566210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb94e0c-40f6-4d2f-9b4b-687b84294431 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:41.567545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 563/1147] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:41.572652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:41.573068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:41.573208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:41.589595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:41.590854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:41.655268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 585/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:58:41.678406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb94e0c-40f6-4d2f-9b4b-687b84294431 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:41.697469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:41.777045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb94e0c-40f6-4d2f-9b4b-687b84294431 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:41.809352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:41.810138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:41.810412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:41.810686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:41.821022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:41.828591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:41.829709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:41.830899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 564/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:41.835781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:41.926935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:41.933906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f94be-9a38-4c6b-b72a-20342abf1505 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:41.965733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:41.966380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:41.966664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:41.966941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:41.967682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:41.968018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:41.969395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:41.978071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 586/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:41.984511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:42.066856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:42.087744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b612dd-299a-45c4-b150-53a40ae6ddb7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:42.121390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:42.122254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:42.122535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:42.122809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] PATH_INFO: `/v3/users/2aa6001cb5cc4d308d52353f7e854b63` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:42.124015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] RBAC: Authorizing `identity:get_user(user_id=2aa6001cb5cc4d308d52353f7e854b63)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:42.125440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:42.127603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 565/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:41 2022] GET /identity/v3/users/2aa6001cb5cc4d308d52353f7e854b63 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:42.134738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:42.238565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfdff5e-a053-4028-a70d-ed85b6a52271 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:42.270346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:42.271200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:42.271480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:42.271754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] PATH_INFO: `/v3/projects/48a5211a7c944941b5e39e051e30b3fb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:42.272949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] RBAC: Authorizing `identity:get_project(project_id=48a5211a7c944941b5e39e051e30b3fb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:42.274374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c8845-0d56-4438-915a-7a372211ea89 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:42.276099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 587/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:42 2022] GET /identity/v3/projects/48a5211a7c944941b5e39e051e30b3fb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:42.281955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:42.377097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9d7d2-ca45-4c3d-abdd-20d09c2e019b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:42.409245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316154c-c2b0-4283-8349-617608099487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:42.410107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316154c-c2b0-4283-8349-617608099487 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:42.410386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316154c-c2b0-4283-8349-617608099487 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:42.410658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316154c-c2b0-4283-8349-617608099487 None admin] PATH_INFO: `/v3/projects/48a5211a7c944941b5e39e051e30b3fb/users/2aa6001cb5cc4d308d52353f7e854b63/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:42.412591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316154c-c2b0-4283-8349-617608099487 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a5211a7c944941b5e39e051e30b3fb, user_id=2aa6001cb5cc4d308d52353f7e854b63, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:42.413992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316154c-c2b0-4283-8349-617608099487 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:42.426516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 566/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:58:42 2022] PUT /identity/v3/projects/48a5211a7c944941b5e39e051e30b3fb/users/2aa6001cb5cc4d308d52353f7e854b63/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:58:44.413432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0abecb-e4d9-488e-8bd2-8ef4d3ef1f53 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:44.413944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0abecb-e4d9-488e-8bd2-8ef4d3ef1f53 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:44.413944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0abecb-e4d9-488e-8bd2-8ef4d3ef1f53 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:44.415260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 588/1154] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:44.420341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:44.420717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:44.420896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:44.432798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:44.438227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:44.440248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:44.504014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 567/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:44.526982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0abecb-e4d9-488e-8bd2-8ef4d3ef1f53 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:44.552742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:44.625980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0abecb-e4d9-488e-8bd2-8ef4d3ef1f53 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:44.658167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:44.658946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:44.659228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:44.659502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:44.669702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:44.677771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:44.678827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:44.679884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 589/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:44.684869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:44.779800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec7cc-b46d-4d82-9845-3a0a61c973c5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:44.813907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:44.815057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:44.815338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:44.815612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:44.816375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:44.816683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:44.818044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:44.820148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:44.826423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 568/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:44.832099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:44.912669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:44.928428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9406a-72c7-4926-afe0-17d65842c041 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:44.959965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:44.960817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:44.961101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:44.961383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] PATH_INFO: `/v3/users/2aa6001cb5cc4d308d52353f7e854b63` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:44.962546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2aa6001cb5cc4d308d52353f7e854b63)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:44.963982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:44.965567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 590/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:44 2022] GET /identity/v3/users/2aa6001cb5cc4d308d52353f7e854b63 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 15:58:44.971767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:45.067762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c17-afcc-41f4-8290-89b34f7815ea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:45.101102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:45.101750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:45.102036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:45.102314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:45.164832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:45.168796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:45.170242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:45.268147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 569/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:45.274027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:45.369341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1ab6-851d-4f3a-ad56-846cc234f2c7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:45.401502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:45.402346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:45.402628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:45.402901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] PATH_INFO: `/v3/projects/48a5211a7c944941b5e39e051e30b3fb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:45.404090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] RBAC: Authorizing `identity:get_project(project_id=48a5211a7c944941b5e39e051e30b3fb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:45.405503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a00c35-be3b-427c-b6dd-90a2490ee446 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:45.407176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 591/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:45 2022] GET /identity/v3/projects/48a5211a7c944941b5e39e051e30b3fb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:45.413729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:45.504290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:45.508318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2809-ed56-4f30-b915-7497d24640c0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:45.542011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:45.542589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:45.542866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:45.543139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:45.543985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=48a5211a7c944941b5e39e051e30b3fb, user.id=2aa6001cb5cc4d308d52353f7e854b63) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:45.544292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:45.545709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc1fb-1907-4c7e-9e08-c965169fe625 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:45.551271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 570/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:45 2022] GET /identity/v3/role_assignments?user.id=2aa6001cb5cc4d308d52353f7e854b63&scope.project.id=48a5211a7c944941b5e39e051e30b3fb&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:47.580114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81dbc-9978-41bc-a70c-01e1fcb56b80 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:47.580654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81dbc-9978-41bc-a70c-01e1fcb56b80 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:47.580654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81dbc-9978-41bc-a70c-01e1fcb56b80 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:47.582026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 592/1162] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:47.587213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:47.587595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:47.587757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:47.604567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:47.605734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:47.669473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 571/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:47.693508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81dbc-9978-41bc-a70c-01e1fcb56b80 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:47.715031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:47.792296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81dbc-9978-41bc-a70c-01e1fcb56b80 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:47.824861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:47.825489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:47.825766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:47.826041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:47.890143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:47.891505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:47.911154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:47.986134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 593/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:58:47.991927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:48.084325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:48.093139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e176a8-ed1b-4b65-abbb-b10bf03e1966 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:48.125658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:48.127005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:48.127293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:48.127566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:48.134112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:48.135546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8e0bb742-dca7-4c44-a517-85f2066b90e4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:48.150006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:48.151114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:58:48.152000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 572/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 15:58:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:48.157010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:48.252073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd42ab-8594-4d41-92ca-c1edeff0331d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:48.270685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:48.284236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:48.284873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:48.285149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:48.285418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:48.286126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:48.286429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:48.287763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe01b6-0e4a-48e9-b917-68d32f4536e6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:48.294625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 594/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Jun 29 15:58:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:50.273560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f89fa-3cee-41d2-9a62-0b72b62e4d1b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:50.274100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f89fa-3cee-41d2-9a62-0b72b62e4d1b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:50.274100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f89fa-3cee-41d2-9a62-0b72b62e4d1b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:50.275467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 573/1167] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:50.280642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14e14-9a6f-4d6a-aa54-12ea5e981816 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:50.281078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14e14-9a6f-4d6a-aa54-12ea5e981816 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:50.281179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd14e14-9a6f-4d6a-aa54-12ea5e981816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:50.297801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1fd14e14-9a6f-4d6a-aa54-12ea5e981816 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:50.299551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1fd14e14-9a6f-4d6a-aa54-12ea5e981816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:50.362354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 595/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:50.384959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f89fa-3cee-41d2-9a62-0b72b62e4d1b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:50.484827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f89fa-3cee-41d2-9a62-0b72b62e4d1b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:50.516318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:50.517464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:50.517748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:50.518021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:50.518741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:50.520125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d97d-dde4-4369-aa90-df29681709d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:50.535803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 574/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Jun 29 15:58:50 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:52.555098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a24e-3191-480d-8333-de215259b29e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:52.555628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a24e-3191-480d-8333-de215259b29e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:52.555628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59a24e-3191-480d-8333-de215259b29e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:52.557033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 596/1170] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:52.562337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b08119-800d-446c-ac20-014178dca520 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:52.562740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b08119-800d-446c-ac20-014178dca520 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:52.562898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b08119-800d-446c-ac20-014178dca520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:52.579240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-06b08119-800d-446c-ac20-014178dca520 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:52.580485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06b08119-800d-446c-ac20-014178dca520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:52.587534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:52.654605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 575/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:52.678582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a24e-3191-480d-8333-de215259b29e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:52.775257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59a24e-3191-480d-8333-de215259b29e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:52.789135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:52.808574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:52.809371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:52.809649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:52.809919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] PATH_INFO: `/v3/domains/a668ea360e3e44e284ba994c10e72150` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:52.820416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a668ea360e3e44e284ba994c10e72150)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:52.821842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbbca08-c3b4-49d9-b5a1-f6db1781d318 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:52.823479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 597/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Jun 29 15:58:52 2022] GET /identity/v3/domains/a668ea360e3e44e284ba994c10e72150 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:52.830011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b08119-800d-446c-ac20-014178dca520 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:52.929369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b08119-800d-446c-ac20-014178dca520 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:52.961631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:52.962268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:52.962545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:52.962814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:52.963504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:52.964954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d77b5-594a-48ec-9482-db39ed5f0202 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:52.978018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:52.991198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 576/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 15:58:52 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 15:58:55.019626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ce65-9dc2-4ed3-8f86-09540c5985b2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:55.020265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ce65-9dc2-4ed3-8f86-09540c5985b2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:55.020265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382ce65-9dc2-4ed3-8f86-09540c5985b2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:55.021570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 598/1174] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:55.026648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:55.027033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:55.027206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:55.044252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:55.045442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:55.110587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 577/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:55.135134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ce65-9dc2-4ed3-8f86-09540c5985b2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:55.232240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382ce65-9dc2-4ed3-8f86-09540c5985b2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:55.269163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:55.270074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:55.270304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:55.270581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] PATH_INFO: `/v3/domains/a668ea360e3e44e284ba994c10e72150` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:55.271740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=a668ea360e3e44e284ba994c10e72150)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:55.273192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da945b3-31f3-4d0f-9b0c-a2d635767d9b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:55.274804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 599/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Jun 29 15:58:55 2022] GET /identity/v3/domains/a668ea360e3e44e284ba994c10e72150 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:55.280595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:55.374891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68e38-b900-4ce5-90ca-5b1b4f12ac32 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:55.397945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:55.408897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:55.409553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:55.409836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:55.410110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:55.410801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:55.412262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f489-35ce-4b46-bf64-f03eea0c1eba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:55.430869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 578/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:58:55 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 15:58:57.475598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24807cf-6098-425f-b51d-4d4b70b9b49f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:57.476178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24807cf-6098-425f-b51d-4d4b70b9b49f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:57.476178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24807cf-6098-425f-b51d-4d4b70b9b49f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:57.477520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 600/1178] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:58:57.482633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:57.483084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:57.483187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:57.500139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:58:57.501369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:58:57.567672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 579/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:58:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:58:57.592024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24807cf-6098-425f-b51d-4d4b70b9b49f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:57.634888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:57.690175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24807cf-6098-425f-b51d-4d4b70b9b49f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:57.721912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:57.722682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:57.722963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:57.723238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:57.733399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:58:57.741281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:58:57.742488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:58:57.743610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 601/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:58:57.748278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:57.847669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f914dd-3e09-4e08-88d7-236976d6cf37 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:57.857987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:57.883842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:57.884518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:57.884802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:57.885078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:57.885825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:57.886132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:57.887882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:57.896484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 580/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:57.902333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:57.998560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858241a-a55e-4f30-aaa7-0b3e4b151ab7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:58.000015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:58.033188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:58.034035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:58.034312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:58.034581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] PATH_INFO: `/v3/users/761d9d1da581447ba0eabda037b0e343` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:58.046864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] RBAC: Authorizing `identity:get_user(user_id=761d9d1da581447ba0eabda037b0e343)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:58.048813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:58.050413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 602/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:58:57 2022] GET /identity/v3/users/761d9d1da581447ba0eabda037b0e343 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:58.056071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:58.153187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f89e6-aea7-4483-8e38-46017ad6a0df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:58.185194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:58.185832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:58.186111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:58.186382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:58.226149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:58.253168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:58.254544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:58.347174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 581/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:58:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 15:58:58.353041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:58.447493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf9e41-1c84-48a4-9427-46f029766bcb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:58.479800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:58.480659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:58.480939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:58.481210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] PATH_INFO: `/v3/projects/67212d49fc0c4384ae1cef6d83886edc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:58.482362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] RBAC: Authorizing `identity:get_project(project_id=67212d49fc0c4384ae1cef6d83886edc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:58.483762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2e38-e033-4a7e-bf10-c7b3ea2a4883 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:58.485737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 603/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:58:58 2022] GET /identity/v3/projects/67212d49fc0c4384ae1cef6d83886edc => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:58:58.492070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:58:58.558918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:58:58.586917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872601-cd4a-4aa5-bd8d-813a5a2737b1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:58:58.619953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:58:58.620582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:58:58.620860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:58:58.621131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:58:58.621946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=67212d49fc0c4384ae1cef6d83886edc, user.id=761d9d1da581447ba0eabda037b0e343) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:58:58.622253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:58:58.623675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fd7d5-c191-4294-970a-d0416708bcd4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:58:58.628889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 582/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:58:58 2022] GET /identity/v3/role_assignments?user.id=761d9d1da581447ba0eabda037b0e343&scope.project.id=67212d49fc0c4384ae1cef6d83886edc&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:00.620410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a05d-d3ff-4a31-883f-291fbffcd7dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:00.620935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a05d-d3ff-4a31-883f-291fbffcd7dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:00.621043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989a05d-d3ff-4a31-883f-291fbffcd7dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:00.622327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 604/1186] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:59:00.627492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:00.627888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:00.628068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:00.644333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:59:00.645494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:59:00.708888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 583/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:59:00.731470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989a05d-d3ff-4a31-883f-291fbffcd7dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:00.758930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:00.828961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989a05d-d3ff-4a31-883f-291fbffcd7dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:00.862122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:00.862894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:00.863175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:00.863449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:00.873224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:59:00.880950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:59:00.882046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 15:59:00.882921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 605/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:59:00.888413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:00.951313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:00.985780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11988628-731f-4951-9f5a-9de82687fc4e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:01.019230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:01.019908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:01.020190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:01.020462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:01.021195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:59:01.021496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:01.022853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:01.030526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 584/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:01.036881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:01.121557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:01.133216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f0e7-bb81-4f1a-9515-47356c8015cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:01.165668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:01.166530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:01.166811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:01.167088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] PATH_INFO: `/v3/users/761d9d1da581447ba0eabda037b0e343` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:01.168290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] RBAC: Authorizing `identity:get_user(user_id=761d9d1da581447ba0eabda037b0e343)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:01.169705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:01.171315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 606/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:59:01 2022] GET /identity/v3/users/761d9d1da581447ba0eabda037b0e343 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:01.177092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:01.272019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b79f-0812-408d-ac80-9bc580e9eb78 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:01.296996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:01.304964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:01.305822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:01.306133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:01.306410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] PATH_INFO: `/v3/projects/67212d49fc0c4384ae1cef6d83886edc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:01.307580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] RBAC: Authorizing `identity:get_project(project_id=67212d49fc0c4384ae1cef6d83886edc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:01.309079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599034e-3483-443c-8a1b-614d4e94b724 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:01.310758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 585/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:59:01 2022] GET /identity/v3/projects/67212d49fc0c4384ae1cef6d83886edc => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:01.317487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:01.415209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb1cea-441d-4f98-8a01-9a7b129069e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:01.447008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:01.447908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:01.448192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:01.448466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] PATH_INFO: `/v3/projects/67212d49fc0c4384ae1cef6d83886edc/users/761d9d1da581447ba0eabda037b0e343/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:01.450393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] RBAC: Authorizing `identity:create_grant(project_id=67212d49fc0c4384ae1cef6d83886edc, user_id=761d9d1da581447ba0eabda037b0e343, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:01.451811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0637fd8-df82-41b8-9ad9-b117298d7924 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:01.464296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 607/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 15:59:01 2022] PUT /identity/v3/projects/67212d49fc0c4384ae1cef6d83886edc/users/761d9d1da581447ba0eabda037b0e343/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 15:59:03.440102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24aa1-3803-4237-866c-61629721fc65 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:03.440626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24aa1-3803-4237-866c-61629721fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:03.440626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24aa1-3803-4237-866c-61629721fc65 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:03.441947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 586/1193] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:59:03.446954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:03.447368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:03.447518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:03.464295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:59:03.465478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:59:03.476350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:03.531242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 608/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 15:59:03.554890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24aa1-3803-4237-866c-61629721fc65 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:03.652755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f24aa1-3803-4237-866c-61629721fc65 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:03.684438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:03.685205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:03.685482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:03.685752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:03.696577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 15:59:03.703992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:59:03.705445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:59:03.706289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 587/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 15:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:59:03.711424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:03.805518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988180-d005-487d-9ab7-c8c7894ae94f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:03.838127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:03.838769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:03.839046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:03.839316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:03.840081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:59:03.840385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:03.841725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:03.849556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 609/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 15:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:03.855068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:03.908682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:03.950503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fa10-bee1-447c-9a29-c64a6e54a686 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:03.982062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:03.982910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:03.983188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:03.983456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] PATH_INFO: `/v3/users/761d9d1da581447ba0eabda037b0e343` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:03.984642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] RBAC: Authorizing `identity:get_user(user_id=761d9d1da581447ba0eabda037b0e343)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:03.986833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:03.988449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 588/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Jun 29 15:59:03 2022] GET /identity/v3/users/761d9d1da581447ba0eabda037b0e343 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:03.994062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:04.006123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:04.090943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377c8a-23b4-4f29-9dca-712f554d0f09 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:04.123706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:04.124368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:04.124648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:04.124921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:04.189636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:04.191056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:04.200210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:04.288341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 610/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 15:59:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 15:59:04.294307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:04.390449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604a8c-1da0-45e6-9317-a2f0fc85bd0d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:04.413001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:04.423889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:04.424731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:04.425012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:04.425284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] PATH_INFO: `/v3/projects/67212d49fc0c4384ae1cef6d83886edc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:04.426444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] RBAC: Authorizing `identity:get_project(project_id=67212d49fc0c4384ae1cef6d83886edc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:04.427910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2db98-f9e5-4c85-9e36-58e901a42a30 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:04.429575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 589/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Jun 29 15:59:04 2022] GET /identity/v3/projects/67212d49fc0c4384ae1cef6d83886edc => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:04.435480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:04.528566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a2b0-19ed-4670-a656-ae4c6371c8e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:04.537793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:04.562043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:04.562611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:04.562888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:04.563160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:04.564039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=67212d49fc0c4384ae1cef6d83886edc, user.id=761d9d1da581447ba0eabda037b0e343) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:59:04.564350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:04.565758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd126bf9-59b6-410f-ac63-83f332445d69 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:04.571326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 611/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 15:59:04 2022] GET /identity/v3/role_assignments?user.id=761d9d1da581447ba0eabda037b0e343&scope.project.id=67212d49fc0c4384ae1cef6d83886edc&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:14.419482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:14.568798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=14 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:59.266124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745052a-28df-41f2-9473-c432ea46be33 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:59.266699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745052a-28df-41f2-9473-c432ea46be33 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:59.266699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745052a-28df-41f2-9473-c432ea46be33 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:59.268341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 590/1201] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 15:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 15:59:59.273614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:59.274130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:59.274215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:59.292501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 15:59:59.293727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 15:59:59.385297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 612/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 15:59:59.412237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745052a-28df-41f2-9473-c432ea46be33 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:59.543952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745052a-28df-41f2-9473-c432ea46be33 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:59.584160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:59.585014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:59.585298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:59.585577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:59.597832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:59.599409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 15:59:59.621753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 15:59:59.623000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 15:59:59.624048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 15:59:59.624048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 15:59:59.624048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 15:59:59.624048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 15:59:59.624048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 591/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 15:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 15:59:59.629904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:59.753612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d43cd-8834-4a38-a3f2-fb407f22f708 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 15:59:59.790536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:59.798319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 15:59:59.798951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 15:59:59.799301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 15:59:59.799540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 15:59:59.800322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 15:59:59.800634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 15:59:59.802043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437a425-8299-45fb-a31d-4218190333f0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 15:59:59.816710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 613/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 15:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 15:59:59.822656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 15:59:59.897018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 15:59:59.960463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c67d20-e860-48b4-b32f-a715ff85918d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:00.010737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:00.011435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:00.011728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:00.012508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:00.013490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:00.015212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bc557-5299-4aff-bfd2-b3e8153e7f1e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:00.043384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 592/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Jun 29 15:59:59 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:00:02.227558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdee45-7959-426d-9b45-ae4ace0f4dda None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:02.228273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdee45-7959-426d-9b45-ae4ace0f4dda None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:02.228273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdee45-7959-426d-9b45-ae4ace0f4dda None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:02.229714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 614/1206] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:02.236153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:02.236744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:02.236744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:02.254898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:02.256236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:02.332721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 593/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 16:00:02.357615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdee45-7959-426d-9b45-ae4ace0f4dda None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:02.490761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdee45-7959-426d-9b45-ae4ace0f4dda None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:02.529443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:02.530260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:02.530541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:02.530898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:02.542820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:02.551469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:02.552488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:02.553352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 615/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 16:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 16:00:02.560236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:02.604708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:02.672823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33297be7-f46a-49f2-a2d9-993710ab3892 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:02.709495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:02.710170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:02.710539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:02.710746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:02.711489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:02.711800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:02.713206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:02.727890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 594/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 16:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:02.733312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:02.792807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:02.861039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaddf1-973f-4df7-8911-5cf94acf18ca None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:02.906157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:02.907139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:02.907536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:02.907931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:02.920026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:02.921462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:02.942116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:02.943157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:02.944289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:02.944289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:02.944289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:02.944289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:02.948333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 616/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:02.950177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:03.065251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:03.072451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a899e-3cc2-4c99-a875-3c95546c3d0f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:03.116754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:03.118038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:03.118438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:03.118752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:03.119917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:03.120255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:03.121915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:03.135456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 595/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:03.141533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:03.249137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43eef5-c5e4-43c9-9dda-0dd891cc719c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:03.250709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:03.285596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:03.286488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:03.286799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:03.287109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:03.296165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:03.297968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:03.314235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:03.315295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:03.316303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 617/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:03.321606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:03.442128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29197510-5f18-47b4-a947-191bb6026615 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:03.489837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:03.491559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:03.491559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:03.491559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:03.492384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:03.492730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:03.494439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:03.523011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 596/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:03.529479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:03.657555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57078-b993-4535-bd06-0793be0fbdd4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:03.694609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:03.695299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:03.695684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:03.695995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:03.734888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:03.778853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:03.782174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:03.897822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 618/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 16:00:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 16:00:03.903992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:03.929340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:04.026693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de38bd7-bb42-4c7e-bcf6-38edfe3d3722 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:04.064915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:04.066189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:04.066470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:04.066742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:04.079483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:04.081028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:04.102330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:04.103342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:04.106013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:04.106013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:04.106013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:04.106013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:04.108817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 597/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:04.110098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:04.179759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:04.224696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89174b1d-c798-4dc8-b662-8060a3255529 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:04.260285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:04.261066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:04.261265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:04.261515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:04.262250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:04.262562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:04.263952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:04.280004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 619/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:04.281312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:04.362547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:04.394215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb48c90-bf87-4e37-9a80-e0b60795c1d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:04.432907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:04.433681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:04.434061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:04.434345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:04.441654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:04.443091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:04.459058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:04.460315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:04.461229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 598/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 16:00:04.466268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:04.588126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf21b3-63ec-4ee2-86bb-544b2dc0c69a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:04.611415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:04.627022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:04.627893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:04.628216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:04.628566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:04.629430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:04.629815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:04.631330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef6247-63d8-4996-a22a-5594d9fd0851 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:04.649086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 620/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:04.650983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:04.780211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536d87a-8f7d-4911-819a-51d70691ed11 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:04.821594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:04.828557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:04.829222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:04.829685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:04.829804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:04.831250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=5a279f9aa024490fa421bb6fe5fd0a64) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:04.831554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:04.833076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47bf64-079d-4a6e-8f16-135888822b95 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:04.842387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 599/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 16:00:04 2022] GET /identity/v3/role_assignments?user.id=5a279f9aa024490fa421bb6fe5fd0a64&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:06.900035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af232-a0dc-41d2-957d-9cd6b3944c2e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:06.900604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af232-a0dc-41d2-957d-9cd6b3944c2e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:06.900604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af232-a0dc-41d2-957d-9cd6b3944c2e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:06.901975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 621/1220] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:00:06.907774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:06.908441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:06.908688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:06.927195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:06.928524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:07.011865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 600/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:07.036005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af232-a0dc-41d2-957d-9cd6b3944c2e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.153935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af232-a0dc-41d2-957d-9cd6b3944c2e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:07.200332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:07.201135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:07.201490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:07.201783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:07.213867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:07.222731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:07.223814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:07.224682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 622/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:07.230639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.345662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1a1bf-947a-40f4-b724-c024e6f473b0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:07.373500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:07.388100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:07.388914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:07.389411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:07.389820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:07.390909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:07.391346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:07.393660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:07.404127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 601/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:07.410846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.459943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:07.527027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97da19-4d74-43c9-a1a2-dc0083d84976 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:07.564388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:07.565307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:07.565626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:07.565927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:07.577156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:07.578584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:07.597572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:07.598694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:07.599792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:07.599792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:07.599792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:07.599792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:07.599792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 623/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:07.605074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.713224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244cc4-772c-474c-b29f-698179d0a462 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:07.749631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:07.750282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:07.750561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:07.750832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:07.751541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:07.751864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:07.753257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:07.765622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 602/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:07.772679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.875709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:07.882827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cc891-463c-422a-ae40-75a5778047d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:07.917332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:07.918188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:07.918477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:07.918868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:07.926468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:07.927929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:07.942059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:07.943190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:07.944357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 624/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 16:00:07.949061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:07.997371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:08.053938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898141b-93ff-4f11-99e5-04e83b00034d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.089187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.089881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.090155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.090403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.091287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:08.091597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.093197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:08.111284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 603/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:08.117392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:08.222422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd835c8-eb10-461e-9e01-1bf337efbf46 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.258485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.259203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.259478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.259746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.271544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.273088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:08.291209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:08.292336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:08.293459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:08.293459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:08.293459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:08.293459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:08.293459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 625/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:08.299737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:08.400421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe9efa-73c0-4bbf-a136-838e3123cf55 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.402884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:08.436450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.437121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.437412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.437719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.438424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:08.438730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.440195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:08.453207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 604/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:08.459506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:08.469494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:08.574508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20262a1-9fb0-4094-af0d-409891cb46db None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.611552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.613001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.613286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.613554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.620683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.622115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:08.637623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:08.638703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:08.639983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 626/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 16:00:08.644764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:08.753838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9381e5-88a5-4204-babd-8a5191adfe21 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.789318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.790007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.790329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.790645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.791465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:08.791813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.793341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b4b63-ac40-4ad3-9613-c837d6814535 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:08.806548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 605/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:08.813911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:08.893162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:08.934156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff7bd-4fda-4d7e-8557-f43153ae5db2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:08.973927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:08.974829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:08.975112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:08.975387 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/5a279f9aa024490fa421bb6fe5fd0a64/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:08.991464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=5a279f9aa024490fa421bb6fe5fd0a64, role_id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:08.992934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e26e1-d20c-44b6-bdeb-66fbc45581ca None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:09.006544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 627/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 16:00:08 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/5a279f9aa024490fa421bb6fe5fd0a64/roles/1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:00:11.055431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02445d97-6fd0-4640-abca-7290214ae1f7 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.056033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02445d97-6fd0-4640-abca-7290214ae1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.056159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02445d97-6fd0-4640-abca-7290214ae1f7 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.057636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 606/1233] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:11.063387 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.063915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.064035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.083326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:11.084568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:11.160775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 628/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:11.190366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02445d97-6fd0-4640-abca-7290214ae1f7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:11.215276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:11.298043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02445d97-6fd0-4640-abca-7290214ae1f7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:11.335760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:11.336517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.336793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.337060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.347642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:11.356928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:11.358075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:11.359123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 607/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Jun 29 16:00:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:11.369331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:11.421583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:11.483321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea5c1-1b4e-4401-ba1f-66faa8c9331d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:11.519664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:11.520349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.520628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.520897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.521632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:11.521936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:11.524794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:11.534354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 629/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Jun 29 16:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:11.540061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:11.628084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:11.647265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ae38-2339-484e-828b-9d65962e6068 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:11.683314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:11.684143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.684424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.684694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.695273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:11.696968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:11.717034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:11.718144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:11.719277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:11.719277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:11.719277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:11.719277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:11.723645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 608/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:11.724643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:11.843191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c72c2-37fe-4cd4-9b8e-177fd9e52a08 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:11.858002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:11.890834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:11.891431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:11.891717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:11.892033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:11.892768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:11.893079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:11.894986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:11.911899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 630/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:11.913560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:12.025205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff62271-a2d3-4ede-b664-31305da4206b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:12.060072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:12.060879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:12.061160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:12.061434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:12.064162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:12.070342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:12.072308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:12.088209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:12.089463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:12.090648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 609/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:12.095662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:12.201780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2d9e-93e5-494e-8adc-e58f1add6669 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:12.238764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:12.239770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:12.240121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:12.240431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:12.241299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:12.241621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:12.243113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:12.262011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 631/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:12.268476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:12.377450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f39-f42a-4c66-87d4-aff8eb761dd4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:12.414330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:12.414330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:12.414330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:12.414330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:12.480782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:12.489305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:12.491312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:12.607635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 610/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 16:00:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 16:00:12.614110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:12.642769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:12.720705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdad2ae-167d-40fb-a010-e927ceee50c1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:12.759207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:12.759981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:12.760328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:12.760649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:12.772066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:12.773944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:12.794730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:12.795700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:12.796635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:12.796635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:12.796635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:12.796635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:12.796635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 632/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:12.802902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:12.919338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:12.926649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0af1-67fa-497a-895f-09892f686d71 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:12.963150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959212e1-8310-4582-b434-5399d9156186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:12.963813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959212e1-8310-4582-b434-5399d9156186 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:12.964155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959212e1-8310-4582-b434-5399d9156186 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:12.964430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959212e1-8310-4582-b434-5399d9156186 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:12.965146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959212e1-8310-4582-b434-5399d9156186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:12.965451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959212e1-8310-4582-b434-5399d9156186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:12.966817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959212e1-8310-4582-b434-5399d9156186 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:12.979521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 611/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:12.985498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:13.067297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:13.096087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8773d-f1ba-4ae1-9c84-52537d525d9d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:13.135051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:13.135868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:13.136154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:13.136439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:13.144235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:13.145794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:13.165443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:13.166661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:13.167965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:13.170066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 633/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:13.176643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959212e1-8310-4582-b434-5399d9156186 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:13.295376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959212e1-8310-4582-b434-5399d9156186 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:13.335187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:13.335778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:13.336088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:13.336368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:13.337144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:13.337450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:13.338870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999948ea-43ca-49a4-99d4-9cee598ad326 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:13.353745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 612/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:13.361015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:13.475607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149f72-7b6c-4b72-b836-cbf0ad4816ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:13.514244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:13.515015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:13.515420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:13.515743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:13.516848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] RBAC: Adding query filter params (role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=5a279f9aa024490fa421bb6fe5fd0a64) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:13.517208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:13.519449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3804d2-67a3-435e-9a79-de18b2820310 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:13.527000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 634/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 16:00:13 2022] GET /identity/v3/role_assignments?user.id=5a279f9aa024490fa421bb6fe5fd0a64&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=1ffc1c7ce08c4bdebfa4d6f4e7f541c6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:15.746471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90699-297d-4bce-afee-c5dca7842d8a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:15.747030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90699-297d-4bce-afee-c5dca7842d8a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:15.747118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90699-297d-4bce-afee-c5dca7842d8a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:15.748566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 613/1247] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:15.754490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:15.754956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:15.755102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:15.760176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:15.775783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:15.777502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:15.856268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 635/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:15.883272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90699-297d-4bce-afee-c5dca7842d8a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:15.903302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:16.000799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90699-297d-4bce-afee-c5dca7842d8a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.040132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.040933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.041227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.041489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.054994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:16.062848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:16.064037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:16.066016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 614/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 16:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:16.071039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:16.192852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b681-0d8c-4aa1-bb22-8aaf3c0c12f4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.225670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:16.232500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.233201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.233485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.233761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.234517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:16.234826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:16.236372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:16.247329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 636/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:16.253895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:16.340126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:16.367116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066568c-c41a-4397-a81c-0b169769a0b7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.406342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.407145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.407425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.407699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.419089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:16.420572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:16.438590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:16.439727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:16.440876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:16.440876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:16.440876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:16.440876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:16.440876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 615/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:16.445476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:16.557397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16c3a5-89c5-4af7-bdc5-cf1bb43aeac5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.594798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.595459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.595739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.596068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.597420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:16.597811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:16.599303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:16.613153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 637/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:16.619867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:16.739868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11d6b-bf20-4f8f-9b6e-a8d69c421b1c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.767152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:16.776924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.777768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.778101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.778413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.787755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:16.789296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:16.804938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:16.806195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:16.807192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 616/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:16.812256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:16.880048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:16.933618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007f66d-3e8a-4726-95b4-f8f7dc83a244 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:16.970733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:16.971461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:16.971780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:16.972035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:16.972958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:16.973311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:16.974702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:16.994679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 638/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:17.000590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:17.120539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42bae-d96f-4e12-a830-1a00c8d01948 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:17.157003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:17.157662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:17.157952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:17.158229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:17.217563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:17.230648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:17.232482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:17.340141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 617/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 16:00:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 16:00:17.345967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:17.461702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087892a-8585-4412-b391-c6ae7c2f252c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:17.476470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:17.501338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:17.502225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:17.502538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:17.502820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:17.513701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:17.515217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:17.535315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:17.536440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:17.541992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:17.541992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:17.541992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:17.541992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:17.541992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 639/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 16:00:17.542697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:17.638914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:17.654200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61ba9-52d9-4726-bed0-24f91f4ed80c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:17.690516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:17.691288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:17.691577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:17.691952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:17.692786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:17.693155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:17.694663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:17.707284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 618/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:17.713032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:17.838426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155411e2-d479-4673-a106-1b98178eee90 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:17.882520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:17.883332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:17.883615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:17.883920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:17.893429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:17.894936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:17.909612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:17.910753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:17.912071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 640/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:17.916773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:18.021376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93768f96-257a-4ec4-98dd-5991909842b2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:18.059596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:18.060292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:18.060573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:18.060846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:18.061629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:18.061939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:18.063372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd08d0-d4c1-4577-9f29-65cfd9a7ff7d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:18.076280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 619/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:18.082927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:18.109626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:18.192990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd46350-b8c1-4462-9530-4fb192d51729 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:18.228511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:18.229119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:18.229429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:18.229677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:18.230512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=5a279f9aa024490fa421bb6fe5fd0a64) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:18.230863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:18.232271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157dcbc-9db5-41d6-b04b-3c6369e159f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:18.238069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 641/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 16:00:18 2022] GET /identity/v3/role_assignments?user.id=5a279f9aa024490fa421bb6fe5fd0a64&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:20.281156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa39b7-ff6f-44c4-81b8-c10995a76b17 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:20.281678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa39b7-ff6f-44c4-81b8-c10995a76b17 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:20.281678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa39b7-ff6f-44c4-81b8-c10995a76b17 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:20.283056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 620/1261] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:20.288669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:20.289043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:20.289228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:20.306093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:20.307271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:20.371447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 642/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:20.393380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa39b7-ff6f-44c4-81b8-c10995a76b17 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:20.403899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:20.491924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa39b7-ff6f-44c4-81b8-c10995a76b17 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:20.524877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:20.525643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:20.525921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:20.526191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:20.536549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:20.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:20.545196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:20.546367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 621/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 16:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:20.551131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:20.568580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:20.646740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d899f-832d-4cf2-a17d-fea300296958 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:20.679243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:20.679911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:20.680190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:20.680458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:20.681192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:20.681491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:20.682831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:20.690509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 643/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 16:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:20.696521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:20.760164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:20.792555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41027e3f-e388-4b33-b17f-4a946d26e745 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:20.827295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:20.828082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:20.828364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:20.828659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:20.840954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:20.842604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:20.861581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:20.863144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:20.868942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:20.868942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:20.868942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:20.868942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:20.868942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 622/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:20.869289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:20.949878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:20.968977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc754861-a72c-49b5-94cd-986ce876914f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.000476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.001121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.001400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.001672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.002384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:21.003180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.004556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.015767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 644/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:21.022029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.118367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45742b-1ed4-44bf-9e88-933eee7c1266 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.137646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:21.151751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.152565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.152840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.153106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.160271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.161698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:21.175965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:21.177053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:21.178390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 623/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:21.182885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.281848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e22fa-7ef0-4599-9b5e-7e088cc027fc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.314130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.314790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.315074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.315983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.316816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:21.317126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.318534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.326816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:21.335172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 645/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:21.340758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.436667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed324-e140-4116-9f88-71653c57a652 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.469118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.469892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.470170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.470441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.480593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.482023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:21.499387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:21.500461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:21.501580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:21.501580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:21.501580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:21.501580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:21.501580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 624/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:21.506622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.607418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67aa3e7-efff-42b9-b95e-5bc9f409092d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.640970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.641619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.641902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.642179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.642903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:21.643239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.644622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.655722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 646/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:21.661832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.692911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:21.759366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884250-5543-4e19-a72f-dbf2dbe090e4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.791585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.792373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.792655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.792927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.799373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.801374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:21.817303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:21.818670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:21.819927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 625/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:21.824954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:21.892990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:21.934060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94f5d1-0aff-4530-a3d5-8c2d08fb3ff9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:21.966161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:21.966813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:21.967094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:21.967369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:21.968164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:21.968476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:21.969884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a2b40-d27f-4e67-98b0-50375148e344 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:21.982729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 647/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:21.988890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:22.075719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:22.085162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98067a69-d6f6-48a6-b2c6-9620a5eccf4f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:22.118504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:22.119379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:22.119659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:22.119962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] PATH_INFO: `/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/5a279f9aa024490fa421bb6fe5fd0a64/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:22.121888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc81b5cd9db40abac74dbd8cc0c7bff, user_id=5a279f9aa024490fa421bb6fe5fd0a64, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:22.123305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a338a74-3634-49db-a815-1bba183d34ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:22.135724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 626/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Jun 29 16:00:21 2022] PUT /identity/v3/projects/0fc81b5cd9db40abac74dbd8cc0c7bff/users/5a279f9aa024490fa421bb6fe5fd0a64/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:00:24.114564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a406-2071-4039-bd6b-a6b6b4473587 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.115005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a406-2071-4039-bd6b-a6b6b4473587 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.115106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a406-2071-4039-bd6b-a6b6b4473587 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.116512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 648/1274] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:24.121749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.122181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.122278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.138499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:24.139662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:24.204573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 627/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:24.229308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a406-2071-4039-bd6b-a6b6b4473587 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:24.332765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a406-2071-4039-bd6b-a6b6b4473587 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:24.350043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:24.366637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:24.367415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.367691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.367986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.377572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 16:00:24.385173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:24.386292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 16:00:24.387353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:24.391258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 649/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Jun 29 16:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:24.392389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:24.475337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:24.493901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d794f20-f21d-4297-bf61-c998adc57f7a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:24.526626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:24.527283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.527563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.527845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.528610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:24.528914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:24.530274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:24.538632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 628/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Jun 29 16:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:24.544341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:24.640685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697ba4f-eaf4-4ea8-a5b7-da7f75dcea2a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:24.672829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:24.673608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.673888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.674159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.685198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:24.686614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:24.703676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:24.704835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:24.706537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:24.706537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:24.706537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:24.706537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:24.706537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 650/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:24.711235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:24.806772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8211f5-a5e7-434c-bffe-93c412ed5080 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:24.839268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:24.839964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.840276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.840549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.841265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:24.841567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:24.842918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:24.854208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 629/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:24.859625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:24.889787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:24.956789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a067b7-9a26-4cdc-93da-45e1072e758c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:24.989131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:24.989920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:24.990203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:24.990479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:24.998027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:24.999456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 16:00:25.014169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:25.015265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:25.016619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 651/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:25.021152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:25.024898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:25.117997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e894e-fb0e-45b3-887d-6e56aa8a56ad None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:25.150402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:25.151060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:25.151342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:25.151618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:25.152471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:25.152779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:25.154233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.171199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 630/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:25.177460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:25.264828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:25.274347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1f100-7df1-4a9c-9226-12cbe75fb7a2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:25.311914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:25.312561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:25.312842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:25.313117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:25.379092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:25.380549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.464530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:25.475233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 652/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 16:00:25.480992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:25.539617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:25.576300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051049ba-e466-40a1-bcb4-74a68196ce39 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:25.609810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:25.610580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:25.610861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:25.611131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:25.621561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:25.622986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 16:00:25.639971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:25.641010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:25.642129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 16:00:25.642129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 16:00:25.642129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 16:00:25.642129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:25.642129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 631/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:25.646726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:25.741806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382b46a-84e4-47e7-a432-cb8275b86001 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:25.773879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:25.774516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:25.774796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:25.775068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:25.775777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:25.776108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:25.777439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.788709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 653/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:25.794183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:25.889140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09f44-a3bd-4bec-a94f-588fb3789c04 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:25.903084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:25.923126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:25.923932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:25.924213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:25.924481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:25.931029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:25.932495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 16:00:25.945900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:25.946934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 29 16:00:25.948083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 632/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:25.952862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:26.001259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:26.049173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cb1b-54cc-48fc-9487-f38abdedea3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:26.081907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:26.082566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:26.082853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:26.083132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:26.083953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:26.084267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:26.085689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38029ccc-7592-43d3-82ac-3208ed0f0b27 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:26.097823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 654/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Jun 29 16:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:26.103747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:26.200591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c881-0977-490a-abcb-16cf341fc356 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:26.232974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:26.233614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:26.233897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:26.234174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:26.235000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] RBAC: Adding query filter params (role.id=282d17c301bf4bbaacf2239857ad1e7e, scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff, user.id=5a279f9aa024490fa421bb6fe5fd0a64) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:26.235312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:26.236768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5cf2e-3271-41d6-964e-5745dbe4c6ca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:26.242692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 633/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Jun 29 16:00:26 2022] GET /identity/v3/role_assignments?user.id=5a279f9aa024490fa421bb6fe5fd0a64&scope.project.id=0fc81b5cd9db40abac74dbd8cc0c7bff&role.id=282d17c301bf4bbaacf2239857ad1e7e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:28.254653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a308-0e35-485c-b04c-2f3d3c7bfe4c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:28.255238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a308-0e35-485c-b04c-2f3d3c7bfe4c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:28.255238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0a308-0e35-485c-b04c-2f3d3c7bfe4c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:28.256647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 655/1288] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:28.261589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:28.262029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:28.262131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:28.278846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:28.280049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:28.308854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:28.345440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 634/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:28.368944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0a308-0e35-485c-b04c-2f3d3c7bfe4c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:28.464904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0a308-0e35-485c-b04c-2f3d3c7bfe4c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:28.475378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:28.498513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:28.499290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:28.499570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:28.499863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:28.500509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:28.501853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:28.513474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:28.514745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:28.515886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 656/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 16:00:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:28.520614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:28.615997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fbab0-b56c-4420-9a95-e30fb6011d7d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:28.647794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:28.648475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:28.648755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:28.649024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:28.649719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:28.650023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:28.651375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f89df0-3c45-47fd-9cd4-7564fcc187d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:28.656130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 635/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jun 29 16:00:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:28.662374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:28.759157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53b1e7-0f2a-4c4f-99e3-0cd18247776a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:28.791567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:28.792239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:28.792524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:28.792799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:28.793502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:28.793810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:28.795171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d33f-038b-4718-ad9e-411012703932 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:28.799464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 657/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jun 29 16:00:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:30.785539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276a14-7947-48bb-880c-e3ff901c9d0c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:30.786103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276a14-7947-48bb-880c-e3ff901c9d0c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:30.786103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e276a14-7947-48bb-880c-e3ff901c9d0c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:30.787459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 636/1293] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:30.792409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949041a-6382-45f1-81a1-ad22799e8c3b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:30.792839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949041a-6382-45f1-81a1-ad22799e8c3b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:30.792966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949041a-6382-45f1-81a1-ad22799e8c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:30.809342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3949041a-6382-45f1-81a1-ad22799e8c3b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:30.810649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3949041a-6382-45f1-81a1-ad22799e8c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:30.842960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:30.885373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 658/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:30.909764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276a14-7947-48bb-880c-e3ff901c9d0c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:30.941233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:31.010891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e276a14-7947-48bb-880c-e3ff901c9d0c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:31.044121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:31.044710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:31.044993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:31.045269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:31.045977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:31.047333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07ab2f-202b-4d61-b6db-c1649eabe95c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:31.059624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 637/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Jun 29 16:00:30 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:00:33.051393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4694-5566-469c-ab3a-9bf30485dba3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.051938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4694-5566-469c-ab3a-9bf30485dba3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.052049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf4694-5566-469c-ab3a-9bf30485dba3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.053328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 659/1296] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:33.058424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.058868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.058968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.075746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:33.076961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:33.147607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 638/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:33.170147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf4694-5566-469c-ab3a-9bf30485dba3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:33.268440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf4694-5566-469c-ab3a-9bf30485dba3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:33.301063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:33.301911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.302141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.302415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.303062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:33.304449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:33.316889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:33.318118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:33.319215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 660/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 16:00:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:33.323991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:33.341709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:33.420187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ead2db-2506-4a62-a098-b17f143687a8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:33.453149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:33.453789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.454069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.454341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.455030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:33.455329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:33.456728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:33.461651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 639/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jun 29 16:00:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:00:33.467400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:33.498240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:33.564248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173d5e-ba81-413f-9225-adf97b67bfb2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:33.595461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:33.596122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.596935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.597215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.597998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] RBAC: Adding query filter params (interface=public, service_id=092b7519356945218e832743f09f89d0, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:33.598310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:33.599658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3a0e8-8e83-4cf6-a974-b19eff8b265f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:33.604575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 661/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Jun 29 16:00:33 2022] GET /identity/v3/endpoints?service_id=092b7519356945218e832743f09f89d0&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:33.610096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:33.687992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:33.705607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9c33-bd62-4f11-b645-263bf0836d93 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:33.738935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:33.739576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:33.739884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:33.740165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:33.740835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:33.742187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff62eb-60c3-4686-b1c0-d0477d106df6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:33.749161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 640/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Jun 29 16:00:33 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:00:35.759901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4962e2-8b1e-4f7a-b865-63f9ee8a2552 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:35.760428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4962e2-8b1e-4f7a-b865-63f9ee8a2552 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:35.760428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4962e2-8b1e-4f7a-b865-63f9ee8a2552 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:35.761803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 662/1302] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:00:35.766767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:35.767201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:35.767326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:35.784739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:00:35.785913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:00:35.860594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 641/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:00:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 16:00:35.884424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4962e2-8b1e-4f7a-b865-63f9ee8a2552 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:35.978992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:35.985822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4962e2-8b1e-4f7a-b865-63f9ee8a2552 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:36.018153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:36.019425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:36.019699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:36.019998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:36.020641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:36.021982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 16:00:36.033555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 16:00:36.034717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 29 16:00:36.035788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 663/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Jun 29 16:00:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 16:00:36.040797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:36.114515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:36.137097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49793f90-7398-413a-98e5-96df5b112dbf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:36.169999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:36.170650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:36.170930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:36.171205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:36.171929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:00:36.172235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:36.173591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adfa67-f067-4a2a-badd-eba2dea1c545 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:36.179124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 642/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Jun 29 16:00:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:00:36.184808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:00:36.280124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156092-09f7-4a61-bf8e-2f66ae0ccc75 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:00:36.311816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:00:36.312475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:00:36.312754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:00:36.313029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:00:36.313748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:00:36.315082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ed2ba-916d-4520-92a0-ed3dd65a5a50 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:00:36.333293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 664/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Jun 29 16:00:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:00:46.176156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=30 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:00:46.329117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:38.467558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d688-3e6d-4f15-97da-ff84cc3309ea None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:38.468061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d688-3e6d-4f15-97da-ff84cc3309ea None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:38.468609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871d688-3e6d-4f15-97da-ff84cc3309ea None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:38.476903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f49d-fb73-4e8f-92b7-c3067a1f9ae5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:38.477510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f49d-fb73-4e8f-92b7-c3067a1f9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:38.477974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f49d-fb73-4e8f-92b7-c3067a1f9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:38.480233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 643/1307] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:38 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:38.568767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-38e8f49d-fb73-4e8f-92b7-c3067a1f9ae5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:38.569931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-38e8f49d-fb73-4e8f-92b7-c3067a1f9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:38.708286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 665/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:01:38.743057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:38.743359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:38.743623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:38.745284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 644/1309] 10.222.0.47 () {54 vars in 964 bytes} [Wed Jun 29 16:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:38.754915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475add-adbf-4e7c-9d9b-1e571c1fb744 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:38.755204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475add-adbf-4e7c-9d9b-1e571c1fb744 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:38.755483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff475add-adbf-4e7c-9d9b-1e571c1fb744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:38.845676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ff475add-adbf-4e7c-9d9b-1e571c1fb744 None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:38.847213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff475add-adbf-4e7c-9d9b-1e571c1fb744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:38.871636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:38.936875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 666/1310] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Jun 29 16:01:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:38.945496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:38.947241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:39.061290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d83a13-488f-4fd6-a56a-d9820ec74c2b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:39.147218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:39.148245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:39.148734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:39.149206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:39.151336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:39.212744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:39.274699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:39.276518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c9af-6f29-46bf-99fe-dbdcfd90e7a9 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:39.297605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 645/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:41.679618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:41.680206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:41.680206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:41.681644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 667/1312] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:41.686975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c999-72ba-4995-b8be-dcdf05693508 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:41.687399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c999-72ba-4995-b8be-dcdf05693508 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:41.687533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543c999-72ba-4995-b8be-dcdf05693508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:41.757360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e543c999-72ba-4995-b8be-dcdf05693508 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:41.758550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e543c999-72ba-4995-b8be-dcdf05693508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:41.853789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 646/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:41.892023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:41.893617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:41.997554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f7e55-0d83-429b-b445-ec2ea2f455ed None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:42.073871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:42.079058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:42.079751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:42.080035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:42.080311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:42.082048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:42.195737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:42.197197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f3c10-baa0-49c3-bf0c-c06a98dd125e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:42.216244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 668/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:44.524677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:44.525167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:44.525286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:44.526636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 647/1315] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:01:44.531632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140714e-fff3-468e-9dbf-5d990831120f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:44.532017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140714e-fff3-468e-9dbf-5d990831120f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:44.532231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140714e-fff3-468e-9dbf-5d990831120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:44.594971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7140714e-fff3-468e-9dbf-5d990831120f None None] MFA Rules not processed for user `91e1d83ea82f46f9a9268d80fd86c1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:44.596212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7140714e-fff3-468e-9dbf-5d990831120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:44.647342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:44.692691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 669/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:44.731140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:44.732733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:44.743284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:44.836635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4d45-0af2-4f0d-84ca-5c7e9e04e1a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:44.909433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:44.910583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:44.910860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:44.911133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:44.912803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:44.972362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:45.019540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:45.020995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a937e-713a-4968-aa21-e4456a3dd946 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:45.038905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 648/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:47.576837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:47.577398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:47.577398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:47.578751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 670/1318] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:47.584108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f62da-7168-4bb4-a996-5634d7a339d0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:47.584546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f62da-7168-4bb4-a996-5634d7a339d0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:47.584695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f62da-7168-4bb4-a996-5634d7a339d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:47.647789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0b3f62da-7168-4bb4-a996-5634d7a339d0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:47.649018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0b3f62da-7168-4bb4-a996-5634d7a339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:47.743411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 649/1319] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:47.781669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:47.783197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:47.884945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9b556-a416-4755-989e-361bd6cbfabe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:47.954875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:47.955506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:47.955783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:47.956088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:47.957798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:47.964933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:48.064722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:48.066133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4422d8b-d144-41cb-957f-694713b01dd5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:48.083789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 671/1320] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:50.760159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:50.760688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:50.760688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:50.762126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 650/1321] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:50.767445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03a95-c802-41b9-9d8b-c1f9d3de0b8d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:50.767933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03a95-c802-41b9-9d8b-c1f9d3de0b8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:50.768033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03a95-c802-41b9-9d8b-c1f9d3de0b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:50.834090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7ce03a95-c802-41b9-9d8b-c1f9d3de0b8d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:50.835329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7ce03a95-c802-41b9-9d8b-c1f9d3de0b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:50.900447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:50.950692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 672/1322] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:50.987237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:50.988960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:51.010222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:51.100316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea4129-af4e-413a-b27f-23ab5436f359 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:51.176728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:51.177380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:51.177658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:51.177930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:51.179597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:51.253571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:51.299621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:51.301532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979be6a-5636-4f66-80ba-64de33ac1e9d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:51.320180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 651/1323] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:53.418204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:53.418711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:53.418711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:53.420170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 673/1324] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:53.425348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a7b5-560f-4f7f-8a6a-bd71c2e106ce None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:53.425781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a7b5-560f-4f7f-8a6a-bd71c2e106ce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:53.426065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a7b5-560f-4f7f-8a6a-bd71c2e106ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:53.490367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7595a7b5-560f-4f7f-8a6a-bd71c2e106ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:53.491812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7595a7b5-560f-4f7f-8a6a-bd71c2e106ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:53.589724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 652/1325] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:53.626260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:53.628027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:53.730741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a31ccc-7b1e-41ca-88f7-342f5518afde None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:53.806683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:53.807326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:53.807605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:53.808020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:53.809658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:53.827005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:53.920779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:53.922331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512148-075f-44cc-9f15-131f61af2ee2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:53.948067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 674/1326] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:56.043004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:56.043515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:56.043515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:56.044987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 653/1327] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:56.050384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1542-313a-4d41-8631-c7ff6cc22c38 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:56.050835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1542-313a-4d41-8631-c7ff6cc22c38 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:56.051009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c1542-313a-4d41-8631-c7ff6cc22c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:56.118051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b03c1542-313a-4d41-8631-c7ff6cc22c38 None None] MFA Rules not processed for user `91e1d83ea82f46f9a9268d80fd86c1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:56.119303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b03c1542-313a-4d41-8631-c7ff6cc22c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:56.186990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:56.219017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 675/1328] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:56.263939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:56.265474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:56.297169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:56.375452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2b82-6295-430d-8b27-05668449c4ca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:56.450790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:56.451444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:56.451729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:56.452045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:56.453703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:56.543974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:56.579290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:56.580789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1ae79-23b0-4684-9a7c-1cb239f31cca service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:56.600005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 654/1329] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:01:58.861014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:58.861517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:58.861517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:58.862855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 676/1330] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:01:58.868187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732eab-abc3-465b-833f-7bf42b2ee63a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:58.868655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732eab-abc3-465b-833f-7bf42b2ee63a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:58.868753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732eab-abc3-465b-833f-7bf42b2ee63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:58.931949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-54732eab-abc3-465b-833f-7bf42b2ee63a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:01:58.933139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54732eab-abc3-465b-833f-7bf42b2ee63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:59.027809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 655/1331] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:01:59.063128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:01:59.064690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:59.167038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e486b68-6b08-47d3-81ba-96b91a8d7040 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:01:59.236882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:01:59.237522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:01:59.237801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:01:59.238073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:01:59.239730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:01:59.265929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:01:59.346988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:01:59.348480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e304ee0-6f66-4f24-8f84-f3cc1cc06992 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:01:59.365864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 677/1332] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:01.428682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:01.429239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:01.429239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:01.430523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 656/1333] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:01.435720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a780-943f-443a-89a4-b97f78774f9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:01.436229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a780-943f-443a-89a4-b97f78774f9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:01.436338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2a780-943f-443a-89a4-b97f78774f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:01.499635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e1c2a780-943f-443a-89a4-b97f78774f9f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:01.500851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e1c2a780-943f-443a-89a4-b97f78774f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:01.574109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:01.596627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 678/1334] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:02:01.636852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:01.638371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:01.678610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:01.741088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1137a-8d08-48b1-920c-b138b1c7d863 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:01.811406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:01.812063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:01.812343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:01.812614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:01.814225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:01.895395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:01.920460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:01.921889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8e910-3bdb-497e-aacc-5b9649ac9660 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:01.939674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 657/1335] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:04.273604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:04.274134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:04.274249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:04.275587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 679/1336] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:04.280811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b1f6-7bb8-4feb-a0df-1b5bdd2f1508 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:04.281262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b1f6-7bb8-4feb-a0df-1b5bdd2f1508 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:04.281371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b1f6-7bb8-4feb-a0df-1b5bdd2f1508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:04.346417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-da62b1f6-7bb8-4feb-a0df-1b5bdd2f1508 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:04.347525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-da62b1f6-7bb8-4feb-a0df-1b5bdd2f1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:04.441414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 658/1337] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:04.477301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:04.478885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:04.579497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dae1e9-68cf-47bb-8ddf-2f6abb740251 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:04.651155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:04.651733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:04.652046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:04.652325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:04.653942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:04.688780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:04.761748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:04.763183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc68cf5-9fc2-43bc-9f46-2021af572730 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:04.780774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 680/1338] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:08.711865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a13-c05a-4a25-bff6-40faf24d26e2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:08.712424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a13-c05a-4a25-bff6-40faf24d26e2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:08.712424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1998a13-c05a-4a25-bff6-40faf24d26e2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:08.713802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 659/1339] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:08.719089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5a729-8aaf-4db7-ab39-78cf255e4374 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:08.719504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5a729-8aaf-4db7-ab39-78cf255e4374 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:08.719657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5a729-8aaf-4db7-ab39-78cf255e4374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:08.793084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ae5a729-8aaf-4db7-ab39-78cf255e4374 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:08.794280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ae5a729-8aaf-4db7-ab39-78cf255e4374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:08.889243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:08.903173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 681/1340] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:08.954001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c781-b72c-4084-996c-449e041a92c3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:08.954283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c781-b72c-4084-996c-449e041a92c3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:08.954564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c781-b72c-4084-996c-449e041a92c3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:08.955966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 660/1341] 10.222.0.47 () {54 vars in 964 bytes} [Wed Jun 29 16:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:02:08.962383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a3f4-95f5-4f8b-bd03-660bb4219402 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:08.962673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a3f4-95f5-4f8b-bd03-660bb4219402 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:08.962954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a3f4-95f5-4f8b-bd03-660bb4219402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:09.034744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1995a3f4-95f5-4f8b-bd03-660bb4219402 None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:09.036047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1995a3f4-95f5-4f8b-bd03-660bb4219402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:09.113592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 682/1342] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Jun 29 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:09.123203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c781-b72c-4084-996c-449e041a92c3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:09.135387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c781-b72c-4084-996c-449e041a92c3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:09.138811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:09.139497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:09.139731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:09.140036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:09.149632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:09.151485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce90d5-732d-4ed6-894b-d015521c870e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:09.161199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 661/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:12.497876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:12.498383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:12.498506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:12.499813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 683/1344] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:12.505328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa206-1851-4e24-a5c5-5f0b76172dee None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:12.505745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa206-1851-4e24-a5c5-5f0b76172dee None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:12.506025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa206-1851-4e24-a5c5-5f0b76172dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:12.533624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-812aa206-1851-4e24-a5c5-5f0b76172dee None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:12.534822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-812aa206-1851-4e24-a5c5-5f0b76172dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:12.553014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:12.614153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 662/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:12.652717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:12.654435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:12.668071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e4750-500b-43c2-b7e0-42c20dfee784 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:12.671672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:12.672389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:12.672672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:12.672945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:12.683209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:12.684717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d00af-5463-4ec0-804e-cb43b8f5cb22 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:12.695782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 684/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:16.777417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4657-ea5b-4479-9c96-5e06bec447fc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:16.777908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4657-ea5b-4479-9c96-5e06bec447fc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:16.778018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e4657-ea5b-4479-9c96-5e06bec447fc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:16.779500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 663/1347] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:16.784788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeced36-147c-43b0-826b-337baea9b203 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:16.785288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeced36-147c-43b0-826b-337baea9b203 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:16.785436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeced36-147c-43b0-826b-337baea9b203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:16.804370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-baeced36-147c-43b0-826b-337baea9b203 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:16.805600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-baeced36-147c-43b0-826b-337baea9b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:16.813885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 685/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:16.852367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e4657-ea5b-4479-9c96-5e06bec447fc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:16.863257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e4657-ea5b-4479-9c96-5e06bec447fc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:16.867227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:16.868223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:16.868502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:16.868776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:16.878289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:16.880355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170205f-04e8-4aa7-8d74-d2de051d76fa service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:16.890834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 664/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:21.873629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c741-9bd5-44c6-9d9d-2c2b71e3eb60 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:21.874625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c741-9bd5-44c6-9d9d-2c2b71e3eb60 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:21.875116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c741-9bd5-44c6-9d9d-2c2b71e3eb60 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:21.876985 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 686/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:21.884094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b208f-dc52-417d-871e-8b13e7a1d934 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:21.884877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b208f-dc52-417d-871e-8b13e7a1d934 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:21.885394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b208f-dc52-417d-871e-8b13e7a1d934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:21.947345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d14b208f-dc52-417d-871e-8b13e7a1d934 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:21.948566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d14b208f-dc52-417d-871e-8b13e7a1d934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:22.033929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 665/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:02:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:26.304104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3fd4-9976-485b-a1e8-88590d4de24f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:26.304617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3fd4-9976-485b-a1e8-88590d4de24f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:26.304697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf3fd4-9976-485b-a1e8-88590d4de24f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:26.306299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 687/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:26.311622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999fa70-b075-4e94-99f2-302fea4a83e9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:26.312432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999fa70-b075-4e94-99f2-302fea4a83e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:26.312708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999fa70-b075-4e94-99f2-302fea4a83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:26.332601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b999fa70-b075-4e94-99f2-302fea4a83e9 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:26.334163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b999fa70-b075-4e94-99f2-302fea4a83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:26.343175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 666/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:02:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:26.799525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=66 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:27.974216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4121-e376-49b1-b5af-66124ecb2d23 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:27.974893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4121-e376-49b1-b5af-66124ecb2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:27.974893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4121-e376-49b1-b5af-66124ecb2d23 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:27.976366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 688/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:27.980984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ecc7-49c3-45bf-8fe4-0f4c69acb238 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:27.981415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ecc7-49c3-45bf-8fe4-0f4c69acb238 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:27.981545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0ecc7-49c3-45bf-8fe4-0f4c69acb238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:27.999692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-70d0ecc7-49c3-45bf-8fe4-0f4c69acb238 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:28.000914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-70d0ecc7-49c3-45bf-8fe4-0f4c69acb238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:28.009650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 667/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:02:31.485932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d4ea-1acc-4279-8d2e-07a057d0b3c2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:31.486501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d4ea-1acc-4279-8d2e-07a057d0b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:31.486501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d4ea-1acc-4279-8d2e-07a057d0b3c2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:31.487884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 689/1356] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:31.494322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce400-2e9e-409b-99f6-db5146dbac6f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:31.494806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce400-2e9e-409b-99f6-db5146dbac6f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:31.494899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce400-2e9e-409b-99f6-db5146dbac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:31.513167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3afce400-2e9e-409b-99f6-db5146dbac6f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:31.514374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3afce400-2e9e-409b-99f6-db5146dbac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:31.522577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 668/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:31.577626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4148e8-11f2-4aa3-8f29-55829e8823ef None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:31.578222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4148e8-11f2-4aa3-8f29-55829e8823ef None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:31.578918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4148e8-11f2-4aa3-8f29-55829e8823ef None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:31.580934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 690/1358] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jun 29 16:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:31.589507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5aa3-7380-41ff-9e54-6f67de7b8048 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:31.590603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5aa3-7380-41ff-9e54-6f67de7b8048 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:31.591270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5aa3-7380-41ff-9e54-6f67de7b8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:31.647664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c34e5aa3-7380-41ff-9e54-6f67de7b8048 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:31.648828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c34e5aa3-7380-41ff-9e54-6f67de7b8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:31.655108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:31.739624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 669/1359] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jun 29 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:02:31.747691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4148e8-11f2-4aa3-8f29-55829e8823ef None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:31.762643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4148e8-11f2-4aa3-8f29-55829e8823ef None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:31.768551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:31.769465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:31.770502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:31.771026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:31.780160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:31.781995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99fa0b-a89f-4a97-8e3d-1cdee51e92e6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:31.792740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 691/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:34.035999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba0dcb-8af1-4098-8106-0ef41d900da2 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:34.036557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba0dcb-8af1-4098-8106-0ef41d900da2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:34.036557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba0dcb-8af1-4098-8106-0ef41d900da2 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:34.037899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 670/1361] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:02:34.043106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696891-246d-4332-95dc-ad463b196e48 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:34.043552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696891-246d-4332-95dc-ad463b196e48 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:34.043648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23696891-246d-4332-95dc-ad463b196e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:34.061125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-23696891-246d-4332-95dc-ad463b196e48 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:34.062324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-23696891-246d-4332-95dc-ad463b196e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:34.070872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 692/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:34.114538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba0dcb-8af1-4098-8106-0ef41d900da2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:34.130304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba0dcb-8af1-4098-8106-0ef41d900da2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:34.136029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:34.136736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:34.137080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:34.137355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:34.148421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:34.149968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164929-534f-48c7-a25c-b0c54de10272 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:34.160045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 671/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:36.526469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813960e-33ea-4a35-b1a3-70cc5a99deb2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:36.526946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813960e-33ea-4a35-b1a3-70cc5a99deb2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:36.526946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813960e-33ea-4a35-b1a3-70cc5a99deb2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:36.528371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 693/1364] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:02:36.533750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3016b-1dde-437a-9d00-d49aa9c50d9a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:36.534172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3016b-1dde-437a-9d00-d49aa9c50d9a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:36.534319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3016b-1dde-437a-9d00-d49aa9c50d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:36.553022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aba3016b-1dde-437a-9d00-d49aa9c50d9a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:36.554197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aba3016b-1dde-437a-9d00-d49aa9c50d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:36.561921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 672/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:36.606775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2ecf-5a37-47d0-b7e1-bf36948c23a4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:36.607059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2ecf-5a37-47d0-b7e1-bf36948c23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:36.607333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab2ecf-5a37-47d0-b7e1-bf36948c23a4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:36.608713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 694/1366] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jun 29 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:02:36.614392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1375-dc4a-45f8-b3f9-05f14a7384a1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:36.614677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1375-dc4a-45f8-b3f9-05f14a7384a1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:36.614951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1375-dc4a-45f8-b3f9-05f14a7384a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:36.633336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-54ab1375-dc4a-45f8-b3f9-05f14a7384a1 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:36.634503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54ab1375-dc4a-45f8-b3f9-05f14a7384a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:36.643526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 673/1367] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jun 29 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:36.651162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab2ecf-5a37-47d0-b7e1-bf36948c23a4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:36.665361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab2ecf-5a37-47d0-b7e1-bf36948c23a4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:36.671523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:36.672561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:36.672908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:36.673066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:36.682365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:36.683963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59665ffa-4ca0-40a5-b599-859634ae155f service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:36.693909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 695/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:38.819359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9344-d192-4ea4-bfd2-79cb053e15ad None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:38.819932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9344-d192-4ea4-bfd2-79cb053e15ad None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:38.819932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f9344-d192-4ea4-bfd2-79cb053e15ad None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:38.821637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 674/1369] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:38.827409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35591-9d47-4926-9d8a-3d773749431e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:38.828083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35591-9d47-4926-9d8a-3d773749431e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:38.828083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35591-9d47-4926-9d8a-3d773749431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:38.846605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6aa35591-9d47-4926-9d8a-3d773749431e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:38.847816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6aa35591-9d47-4926-9d8a-3d773749431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:38.856722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 696/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:38.901792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9344-d192-4ea4-bfd2-79cb053e15ad None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:38.916615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f9344-d192-4ea4-bfd2-79cb053e15ad None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:38.922029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:38.922665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:38.922942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:38.923235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:38.931777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:38.933392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3428-25ba-4569-9121-11e89be8ec20 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:38.943256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 675/1371] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:39.491010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b073-c6f1-4e21-b700-075d3d3c4628 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:39.491527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b073-c6f1-4e21-b700-075d3d3c4628 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:39.491813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b073-c6f1-4e21-b700-075d3d3c4628 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:39.493684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 697/1372] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:39.499143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442892-eb3a-4e27-910f-0497572d5ce2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:39.499434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442892-eb3a-4e27-910f-0497572d5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:39.499710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442892-eb3a-4e27-910f-0497572d5ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:39.518223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b7442892-eb3a-4e27-910f-0497572d5ce2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:39.519422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b7442892-eb3a-4e27-910f-0497572d5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:39.528128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 676/1373] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:39.836793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9169-1f8d-40d1-9a62-36ffb56e3b7b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:39.837249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9169-1f8d-40d1-9a62-36ffb56e3b7b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:39.837334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e9169-1f8d-40d1-9a62-36ffb56e3b7b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:39.838705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 698/1374] 10.222.0.47 () {54 vars in 963 bytes} [Wed Jun 29 16:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:39.843766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69661b-70f8-4c1d-ad77-e09489cd97b2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:39.844205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69661b-70f8-4c1d-ad77-e09489cd97b2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:39.844433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69661b-70f8-4c1d-ad77-e09489cd97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:39.894526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd69661b-70f8-4c1d-ad77-e09489cd97b2 None None] MFA Rules not processed for user `8402cadd9aac46518a45b01b18ef1965`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:39.895783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd69661b-70f8-4c1d-ad77-e09489cd97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:39.962442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 677/1375] 10.222.0.47 () {58 vars in 1060 bytes} [Wed Jun 29 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:39.970584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9169-1f8d-40d1-9a62-36ffb56e3b7b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:39.981729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e9169-1f8d-40d1-9a62-36ffb56e3b7b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:39.985283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:39.985914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:39.986194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:39.986465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:39.996514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:39.997958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfe453-6b81-407b-b301-6563837d1155 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:40.008551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 699/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:41.031976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5750-685e-4fdb-9cc7-cfd28e1a331c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:41.032522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5750-685e-4fdb-9cc7-cfd28e1a331c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:41.032522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5750-685e-4fdb-9cc7-cfd28e1a331c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:41.033934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 678/1377] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:41.039674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96430b-f268-45e0-8adc-41fca038b717 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:41.040094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96430b-f268-45e0-8adc-41fca038b717 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:41.040270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96430b-f268-45e0-8adc-41fca038b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:41.058067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca96430b-f268-45e0-8adc-41fca038b717 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:41.059266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca96430b-f268-45e0-8adc-41fca038b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:41.067155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 700/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:41.110527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e5750-685e-4fdb-9cc7-cfd28e1a331c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:41.125356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e5750-685e-4fdb-9cc7-cfd28e1a331c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:41.130685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:41.131308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:41.131589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:41.131893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:41.139792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:41.141388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1cd70-3641-409b-808b-c5922779a1d5 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:41.151347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 679/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:43.205004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348eff-b9eb-40df-be27-37b06af6ad15 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:43.205545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348eff-b9eb-40df-be27-37b06af6ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:43.205545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348eff-b9eb-40df-be27-37b06af6ad15 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:43.206911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 701/1380] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:43.212604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae769-9df4-4d44-aaea-1146ea96502d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:43.213032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae769-9df4-4d44-aaea-1146ea96502d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:43.213150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ae769-9df4-4d44-aaea-1146ea96502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:43.220155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:43.231951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-044ae769-9df4-4d44-aaea-1146ea96502d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:43.233151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-044ae769-9df4-4d44-aaea-1146ea96502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:43.241100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 680/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:02:43.285113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348eff-b9eb-40df-be27-37b06af6ad15 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:43.299699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348eff-b9eb-40df-be27-37b06af6ad15 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:43.305286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:43.305932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:43.306343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:43.306700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:43.315488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:43.317621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c6c53-3a4c-4221-a9fa-3e0bd74cf279 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:43.327116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 702/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:45.417802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa32e5-8a95-42c7-8085-567914af403b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:45.418274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa32e5-8a95-42c7-8085-567914af403b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:45.418400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa32e5-8a95-42c7-8085-567914af403b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:45.419705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 681/1383] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:45.425094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f45ed-eac9-48c5-9260-8a17ed0a97e0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:45.425541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f45ed-eac9-48c5-9260-8a17ed0a97e0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:45.425676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f45ed-eac9-48c5-9260-8a17ed0a97e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:45.444209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-462f45ed-eac9-48c5-9260-8a17ed0a97e0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:45.445576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-462f45ed-eac9-48c5-9260-8a17ed0a97e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:45.453621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 703/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:45.496655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa32e5-8a95-42c7-8085-567914af403b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:45.511312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa32e5-8a95-42c7-8085-567914af403b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:45.516733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:45.517370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:45.517962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:45.518244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:45.526800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:45.528411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264ac2-303c-4834-97aa-dd51bc83405c service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:45.538673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 682/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:47.590688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8601e-9457-43dc-bb95-543fef1c99dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:47.591238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8601e-9457-43dc-bb95-543fef1c99dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:47.591238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8601e-9457-43dc-bb95-543fef1c99dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:47.592685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 704/1386] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:47.598167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682539f-ab5a-49d6-99ab-0ac9850918dd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:47.599145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682539f-ab5a-49d6-99ab-0ac9850918dd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:47.599227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682539f-ab5a-49d6-99ab-0ac9850918dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:47.618585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1682539f-ab5a-49d6-99ab-0ac9850918dd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:47.620104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1682539f-ab5a-49d6-99ab-0ac9850918dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:47.628285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 683/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:47.673496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8601e-9457-43dc-bb95-543fef1c99dd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:47.688972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8601e-9457-43dc-bb95-543fef1c99dd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:47.694849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:47.695516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:47.695853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:47.696173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:47.705487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:47.707112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c2cd-4dd3-499e-a72a-b2c391d2a4af service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:47.717703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 705/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:49.786109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a1889-4ded-417f-894d-03264e50c934 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:49.786648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a1889-4ded-417f-894d-03264e50c934 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:49.786841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a1889-4ded-417f-894d-03264e50c934 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:49.788746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 684/1389] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:49.795230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf75-e357-415e-a56d-97afaaa51617 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:49.795649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf75-e357-415e-a56d-97afaaa51617 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:49.795795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf75-e357-415e-a56d-97afaaa51617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:49.813796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cb16bf75-e357-415e-a56d-97afaaa51617 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:49.815050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb16bf75-e357-415e-a56d-97afaaa51617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:49.823957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 706/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:49.870607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a1889-4ded-417f-894d-03264e50c934 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:49.885832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a1889-4ded-417f-894d-03264e50c934 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:49.891719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:49.892389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:49.892674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:49.892956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:49.902914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:49.905191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482161dc-eaf0-41bf-b06e-5eb638807ade service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:49.918261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 685/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:51.977617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889881ef-5f8b-4f76-ad05-48316b74ce5b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:51.978126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889881ef-5f8b-4f76-ad05-48316b74ce5b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:51.978126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889881ef-5f8b-4f76-ad05-48316b74ce5b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:51.979641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 707/1392] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:51.985568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b86033-3608-45eb-ab1b-b870df3d3983 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:51.985989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b86033-3608-45eb-ab1b-b870df3d3983 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:51.986313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b86033-3608-45eb-ab1b-b870df3d3983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:52.007288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-81b86033-3608-45eb-ab1b-b870df3d3983 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:52.008467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-81b86033-3608-45eb-ab1b-b870df3d3983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:52.016425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 686/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:52.060756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889881ef-5f8b-4f76-ad05-48316b74ce5b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:52.075914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889881ef-5f8b-4f76-ad05-48316b74ce5b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:52.082420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:52.083892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:52.084315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:52.084761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:52.098269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:52.100892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460570f-700b-435b-bf46-a2b3a347bfeb service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:52.113109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 708/1394] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:54.194619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdbe7-8981-4def-8877-f44cd6c2516d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:54.195145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdbe7-8981-4def-8877-f44cd6c2516d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:54.195236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdbe7-8981-4def-8877-f44cd6c2516d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:54.196588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 687/1395] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:54.201712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1635-2354-46fa-99f2-e68c605ad98b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:54.202139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1635-2354-46fa-99f2-e68c605ad98b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:54.202278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab1635-2354-46fa-99f2-e68c605ad98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:54.219923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-17ab1635-2354-46fa-99f2-e68c605ad98b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:54.221131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-17ab1635-2354-46fa-99f2-e68c605ad98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:54.228988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 709/1396] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:54.273168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccdbe7-8981-4def-8877-f44cd6c2516d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:54.287979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccdbe7-8981-4def-8877-f44cd6c2516d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:54.293326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:54.293956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:54.294240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:54.294547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:54.303337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:54.304941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245fd7-9a20-4460-b565-5be23b5ee782 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:54.314342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 688/1397] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:02:55.255433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc248e8-a2aa-43f3-9b01-f0cad40e2d8e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:55.256010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc248e8-a2aa-43f3-9b01-f0cad40e2d8e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:55.256113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc248e8-a2aa-43f3-9b01-f0cad40e2d8e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:55.257435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 710/1398] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:55.262581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaac48-11bb-44fa-8a7f-a4e79bb83df9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:55.262973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaac48-11bb-44fa-8a7f-a4e79bb83df9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:55.263129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaac48-11bb-44fa-8a7f-a4e79bb83df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:55.282678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-08aaac48-11bb-44fa-8a7f-a4e79bb83df9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:55.283893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-08aaac48-11bb-44fa-8a7f-a4e79bb83df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:55.292021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 689/1399] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:55.347447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8cc45-e1f6-41b6-b0bf-9c6cdc105732 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:55.347671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8cc45-e1f6-41b6-b0bf-9c6cdc105732 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:55.348013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8cc45-e1f6-41b6-b0bf-9c6cdc105732 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:55.349401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 711/1400] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jun 29 16:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:55.354404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb73e-c930-43b9-ab8c-0f991edaa645 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:55.354692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb73e-c930-43b9-ab8c-0f991edaa645 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:55.354967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdb73e-c930-43b9-ab8c-0f991edaa645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:55.403840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4fcdb73e-c930-43b9-ab8c-0f991edaa645 None None] MFA Rules not processed for user `b3d302dfefab4d4a9cad2b67c3c70268`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:55.405039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4fcdb73e-c930-43b9-ab8c-0f991edaa645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:55.466507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 690/1401] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jun 29 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:55.474206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8cc45-e1f6-41b6-b0bf-9c6cdc105732 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:55.484583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8cc45-e1f6-41b6-b0bf-9c6cdc105732 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:55.488082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:55.488711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:55.489525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:55.489805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:55.499486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:55.501571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe6a53-bc95-4753-8d2e-eeacd3537035 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:55.511961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 712/1402] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:56.218815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739506-f210-4726-8bbd-072393d05315 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.219111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739506-f210-4726-8bbd-072393d05315 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.219397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739506-f210-4726-8bbd-072393d05315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.268247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-90739506-f210-4726-8bbd-072393d05315 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:56.269457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-90739506-f210-4726-8bbd-072393d05315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:56.315716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:56.336300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 691/1403] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:56.381099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5697-5aeb-4984-8ac0-41f3ec607201 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.381989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5697-5aeb-4984-8ac0-41f3ec607201 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.382465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5697-5aeb-4984-8ac0-41f3ec607201 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.384031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 713/1404] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:02:56.390128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.390462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.390707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.405878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fe41-e2cf-4e01-81c0-8fb00bdcf155 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.406169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fe41-e2cf-4e01-81c0-8fb00bdcf155 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.406451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814fe41-e2cf-4e01-81c0-8fb00bdcf155 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.407906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 714/1405] 10.222.0.47 () {54 vars in 942 bytes} [Wed Jun 29 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:02:56.409827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:56.411646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:56.414625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72da4-8349-4a3b-adcf-eba4e303fe14 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.414917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72da4-8349-4a3b-adcf-eba4e303fe14 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.415197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72da4-8349-4a3b-adcf-eba4e303fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.419845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 692/1406] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:02:56.463388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-13b72da4-8349-4a3b-adcf-eba4e303fe14 None None] MFA Rules not processed for user `da042356bb0f4417a8f2ace132cb9028`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:02:56.464213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:56.464613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13b72da4-8349-4a3b-adcf-eba4e303fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:02:56.477540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d388c-98a1-4ec8-9db5-568c59a3b5ac None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:56.483226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:56.483888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.484175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.484487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.492802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:56.494651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:56.504586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 693/1407] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:02:56.521551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:02:56.540990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 715/1408] 10.222.0.47 () {58 vars in 1039 bytes} [Wed Jun 29 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:02:56.550939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:02:56.562997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80c8a6-59b9-48e1-b4ba-2972bc0ffe5b service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:02:56.568847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:02:56.569490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:02:56.569779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:02:56.570060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:02:56.579017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:02:56.580686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dd854-1f8f-42fc-9735-84b34b376814 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:02:56.590709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 694/1409] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:03:06.537999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:06.586898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=21 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:18.989973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9068d7-f660-4929-a413-45773e2cb6a8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:18.990532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9068d7-f660-4929-a413-45773e2cb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:18.990532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9068d7-f660-4929-a413-45773e2cb6a8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:18.991968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 716/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Jun 29 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:18.997726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9a0a-0fb4-49d5-bea0-568cc6e35968 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:18.998385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9a0a-0fb4-49d5-bea0-568cc6e35968 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:18.998385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e9a0a-0fb4-49d5-bea0-568cc6e35968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:19.016678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f46e9a0a-0fb4-49d5-bea0-568cc6e35968 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:19.017880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f46e9a0a-0fb4-49d5-bea0-568cc6e35968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:19.027225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 695/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jun 29 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:19.041342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fe7e-8d58-49ca-a75f-e735c9e70d72 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:19.041634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fe7e-8d58-49ca-a75f-e735c9e70d72 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:19.041948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fe7e-8d58-49ca-a75f-e735c9e70d72 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:19.043337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 717/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Jun 29 16:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:19.047686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b0e9-8b03-4aca-af2a-574f5ebfb83e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:19.048005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b0e9-8b03-4aca-af2a-574f5ebfb83e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:19.048286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8b0e9-8b03-4aca-af2a-574f5ebfb83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:19.065571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-28b8b0e9-8b03-4aca-af2a-574f5ebfb83e None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:19.066760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-28b8b0e9-8b03-4aca-af2a-574f5ebfb83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:19.076458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 696/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Jun 29 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:21.546835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bf8b-fb46-4b12-9a70-1a44d9123555 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:21.547365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bf8b-fb46-4b12-9a70-1a44d9123555 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:21.547365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932bf8b-fb46-4b12-9a70-1a44d9123555 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:21.548828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:21.554533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9878f-3ef8-4064-b8d4-5662e37b3ba2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:21.554936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9878f-3ef8-4064-b8d4-5662e37b3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:21.555090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9878f-3ef8-4064-b8d4-5662e37b3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:21.572444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d9b9878f-3ef8-4064-b8d4-5662e37b3ba2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:21.573639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d9b9878f-3ef8-4064-b8d4-5662e37b3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:21.581337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:21.624816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932bf8b-fb46-4b12-9a70-1a44d9123555 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:21.639883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932bf8b-fb46-4b12-9a70-1a44d9123555 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:21.645238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:21.646375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:21.646659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:21.646939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:21.655289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:21.656955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec60947-90d1-4a9a-bc3b-09569e2722d6 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:21.666847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 719/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:22.559741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc344766-c894-406e-9d2a-edea881a12d3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:22.560243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc344766-c894-406e-9d2a-edea881a12d3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:22.560351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc344766-c894-406e-9d2a-edea881a12d3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:22.561703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:22.566446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68785eaf-43b1-4b09-baaa-2c0ce0aa9e12 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:22.566865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68785eaf-43b1-4b09-baaa-2c0ce0aa9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:22.567027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68785eaf-43b1-4b09-baaa-2c0ce0aa9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:22.585865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-68785eaf-43b1-4b09-baaa-2c0ce0aa9e12 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:22.587074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-68785eaf-43b1-4b09-baaa-2c0ce0aa9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:22.594911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:22.742468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc344766-c894-406e-9d2a-edea881a12d3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:22.758224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc344766-c894-406e-9d2a-edea881a12d3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:22.763613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:22.764282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:22.764565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:22.764842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:22.772952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:22.774532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122d98e-99ef-4b12-a901-1ab1c276ee4f service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:22.783749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 699/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:23.657672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0dcbd-0dfd-4228-a567-85782279f804 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:23.658222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0dcbd-0dfd-4228-a567-85782279f804 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:23.658222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0dcbd-0dfd-4228-a567-85782279f804 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:23.659550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:23.664488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0336c4-1e29-4128-b88a-f6a00314cd55 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:23.664906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0336c4-1e29-4128-b88a-f6a00314cd55 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:23.665046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0336c4-1e29-4128-b88a-f6a00314cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:23.683157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2d0336c4-1e29-4128-b88a-f6a00314cd55 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:23.684401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2d0336c4-1e29-4128-b88a-f6a00314cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:23.692297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:23.842299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0dcbd-0dfd-4228-a567-85782279f804 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:23.856551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0dcbd-0dfd-4228-a567-85782279f804 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:23.861867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:23.862500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:23.862779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:23.863050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:23.871803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:23.873388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68e7e-3988-46e3-999e-d476827fc768 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:23.883208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 722/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:24.734725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0397f7-3370-48f2-a117-4830433b805f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:24.735293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0397f7-3370-48f2-a117-4830433b805f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:24.735293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0397f7-3370-48f2-a117-4830433b805f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:24.736677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:24.741570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad187b94-5daf-496a-aa2a-75201c5a5506 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:24.741954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad187b94-5daf-496a-aa2a-75201c5a5506 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:24.742117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad187b94-5daf-496a-aa2a-75201c5a5506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:24.759728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ad187b94-5daf-496a-aa2a-75201c5a5506 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:24.760881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ad187b94-5daf-496a-aa2a-75201c5a5506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:24.768493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:24.920073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0397f7-3370-48f2-a117-4830433b805f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:24.933924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0397f7-3370-48f2-a117-4830433b805f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:24.939170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:24.939793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:24.940098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:24.940369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:24.948487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:24.950052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fec4a-35f7-4d40-a68e-b01186f3d80c service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:24.959976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 702/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:25.823855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142392-87f5-47dd-9c55-b620c03c686d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:25.824440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142392-87f5-47dd-9c55-b620c03c686d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:25.824440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e142392-87f5-47dd-9c55-b620c03c686d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:25.825778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:25.830544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247697a-d56d-4521-a360-28bbb2c270df None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:25.830940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247697a-d56d-4521-a360-28bbb2c270df None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:25.831112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247697a-d56d-4521-a360-28bbb2c270df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:25.850227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9247697a-d56d-4521-a360-28bbb2c270df None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:25.851429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9247697a-d56d-4521-a360-28bbb2c270df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:25.859874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:26.014522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e142392-87f5-47dd-9c55-b620c03c686d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:26.028846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e142392-87f5-47dd-9c55-b620c03c686d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:26.034145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:26.034770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:26.035053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:26.035330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:26.043752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:26.045327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf91d6-172c-4900-ac2b-55ffcda8a6ef service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:26.055357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 725/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:26.850707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727b1e-1658-48d1-aaa2-6ba01e7be2c0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:26.851219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727b1e-1658-48d1-aaa2-6ba01e7be2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:26.851219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3727b1e-1658-48d1-aaa2-6ba01e7be2c0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:26.852562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:26.857514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc47a-a364-4458-9521-84d67bee7ab7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:26.857926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc47a-a364-4458-9521-84d67bee7ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:26.858062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cc47a-a364-4458-9521-84d67bee7ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:26.876228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9f5cc47a-a364-4458-9521-84d67bee7ab7 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:26.877430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9f5cc47a-a364-4458-9521-84d67bee7ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:26.885697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:27.035074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3727b1e-1658-48d1-aaa2-6ba01e7be2c0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:27.049089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3727b1e-1658-48d1-aaa2-6ba01e7be2c0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:27.054836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:27.055460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:27.055738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:27.056037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:27.063925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:27.065487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187cd4-93c2-4108-80c1-0eb45e42d8a3 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:27.075335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 705/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:27.880510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159d08-0fbe-489e-99ff-63a02030284a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:27.881081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159d08-0fbe-489e-99ff-63a02030284a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:27.881081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159d08-0fbe-489e-99ff-63a02030284a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:27.882446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:27.887543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec6a2-6f41-4dd9-8362-f295d807b6a2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:27.887972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec6a2-6f41-4dd9-8362-f295d807b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:27.888154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cec6a2-6f41-4dd9-8362-f295d807b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:27.906306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-48cec6a2-6f41-4dd9-8362-f295d807b6a2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:27.907527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-48cec6a2-6f41-4dd9-8362-f295d807b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:27.915801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:28.072844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159d08-0fbe-489e-99ff-63a02030284a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:28.087466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159d08-0fbe-489e-99ff-63a02030284a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:28.092864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:28.093499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:28.093779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:28.094053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:28.102005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:28.103572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c6c7c-9c33-4d48-91a9-1c7c37b09c5c service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:28.112768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 728/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:28.902184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebf81-1b4b-4e44-aecc-760387d00c60 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:28.902718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebf81-1b4b-4e44-aecc-760387d00c60 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:28.902718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aebf81-1b4b-4e44-aecc-760387d00c60 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:28.904117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:28.908897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185fa2-5daf-42e8-a053-8bfa34a3bb8f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:28.909283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185fa2-5daf-42e8-a053-8bfa34a3bb8f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:28.909458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185fa2-5daf-42e8-a053-8bfa34a3bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:28.927868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-23185fa2-5daf-42e8-a053-8bfa34a3bb8f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:28.929054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-23185fa2-5daf-42e8-a053-8bfa34a3bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:28.936655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:29.084792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aebf81-1b4b-4e44-aecc-760387d00c60 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:29.099408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aebf81-1b4b-4e44-aecc-760387d00c60 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:29.104753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:29.105405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:29.105681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:29.105950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:29.113794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:29.116006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b1c65-6a64-4bd8-ae2a-de8bbdfe3ae0 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:29.125362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 708/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:29.929199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc16-8b34-4cf2-9163-8917b36602b7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:29.929771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc16-8b34-4cf2-9163-8917b36602b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:29.929771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bfc16-8b34-4cf2-9163-8917b36602b7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:29.931154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:29.935941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823bd81-6df3-48cf-8627-7e6aa0aed8e4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:29.936386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823bd81-6df3-48cf-8627-7e6aa0aed8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:29.936498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823bd81-6df3-48cf-8627-7e6aa0aed8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:29.954835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b823bd81-6df3-48cf-8627-7e6aa0aed8e4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:29.956165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b823bd81-6df3-48cf-8627-7e6aa0aed8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:29.964038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:30.119793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bfc16-8b34-4cf2-9163-8917b36602b7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:30.134745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bfc16-8b34-4cf2-9163-8917b36602b7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:30.140081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:30.140727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:30.141000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:30.141275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:30.149230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:30.150779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e51d-8741-4c46-966c-ef61d6825148 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:30.161811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 731/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:32.072148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b136e-6fed-438d-ac89-c478c3f0ee77 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:32.072697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b136e-6fed-438d-ac89-c478c3f0ee77 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:32.072697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b136e-6fed-438d-ac89-c478c3f0ee77 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:32.074356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:32.079591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39f8-2e7f-48c2-9e4e-0265b712cdc5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:32.080086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39f8-2e7f-48c2-9e4e-0265b712cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:32.080186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39f8-2e7f-48c2-9e4e-0265b712cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:32.098235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de7b39f8-2e7f-48c2-9e4e-0265b712cdc5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:32.099417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de7b39f8-2e7f-48c2-9e4e-0265b712cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:32.107094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:32.148054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b136e-6fed-438d-ac89-c478c3f0ee77 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:32.158723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b136e-6fed-438d-ac89-c478c3f0ee77 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:32.162282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:32.162914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:32.163196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:32.163471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:32.173253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:32.174678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9c953-3939-4eae-972e-c60ae8c8a9c4 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:32.184523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 711/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:34.388288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e941ca-f8c5-4a6b-804d-35fd76ea4c8e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:34.388853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e941ca-f8c5-4a6b-804d-35fd76ea4c8e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:34.388853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e941ca-f8c5-4a6b-804d-35fd76ea4c8e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:34.390140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 16:03:34.396516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a3c3-406e-4122-8158-b664fe4030bd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:34.396933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a3c3-406e-4122-8158-b664fe4030bd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:34.397069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a3c3-406e-4122-8158-b664fe4030bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:34.414870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9ec2a3c3-406e-4122-8158-b664fe4030bd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:34.416105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9ec2a3c3-406e-4122-8158-b664fe4030bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:34.423882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:34.461853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e941ca-f8c5-4a6b-804d-35fd76ea4c8e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:34.472248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e941ca-f8c5-4a6b-804d-35fd76ea4c8e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:34.476296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:34.476920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:34.477203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:34.477476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:34.486119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:34.487543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3019e-edfd-4ff5-9fec-fb7377b97239 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:34.497075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 734/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:36.850243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31ae-69ff-4fd0-a02b-5cccc7c201dc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:36.850762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31ae-69ff-4fd0-a02b-5cccc7c201dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:36.850762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d31ae-69ff-4fd0-a02b-5cccc7c201dc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:36.852134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:36.857192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689fba-3265-4424-8480-92bd16fc522a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:36.857592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689fba-3265-4424-8480-92bd16fc522a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:36.857747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689fba-3265-4424-8480-92bd16fc522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:36.875735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-31689fba-3265-4424-8480-92bd16fc522a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:36.876961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-31689fba-3265-4424-8480-92bd16fc522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:36.885271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:36.923761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d31ae-69ff-4fd0-a02b-5cccc7c201dc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:36.934933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d31ae-69ff-4fd0-a02b-5cccc7c201dc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:36.938443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:36.939066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:36.939348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:36.939628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:36.949052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:36.950471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba66b7-1302-4c22-b15f-f38b3f449391 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:36.960243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 714/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:39.113237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283755a7-7ae6-450d-856d-85b8635a75af None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:39.114221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283755a7-7ae6-450d-856d-85b8635a75af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:39.114333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283755a7-7ae6-450d-856d-85b8635a75af None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:39.115654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:39.121146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de574c6-3780-488b-bff3-a5af5b984427 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:39.121600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de574c6-3780-488b-bff3-a5af5b984427 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:39.121713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de574c6-3780-488b-bff3-a5af5b984427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:39.139507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1de574c6-3780-488b-bff3-a5af5b984427 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:39.140716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1de574c6-3780-488b-bff3-a5af5b984427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:39.148685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:39.187665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283755a7-7ae6-450d-856d-85b8635a75af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:39.198849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283755a7-7ae6-450d-856d-85b8635a75af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:39.202319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:39.202937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:39.203214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:39.203488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:39.212155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:39.213555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626fcbc-8ee5-4d5c-a271-3b17e14528c0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:39.222654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 737/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:41.301792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ecf5-fbf6-46e5-814a-6d3e9b8e716b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:41.302315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ecf5-fbf6-46e5-814a-6d3e9b8e716b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:41.302438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ecf5-fbf6-46e5-814a-6d3e9b8e716b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:41.303725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:41.309034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4b20-3639-4d7d-9a3b-ac3899f32e01 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:41.309485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4b20-3639-4d7d-9a3b-ac3899f32e01 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:41.309595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4b20-3639-4d7d-9a3b-ac3899f32e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:41.326588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e92a4b20-3639-4d7d-9a3b-ac3899f32e01 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:41.327770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e92a4b20-3639-4d7d-9a3b-ac3899f32e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:41.336459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:41.373915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ecf5-fbf6-46e5-814a-6d3e9b8e716b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:41.384615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ecf5-fbf6-46e5-814a-6d3e9b8e716b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:41.388100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:41.388731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:41.389011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:41.389282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:41.398491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:41.399952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8d2f4-23aa-4387-8d1b-9da1e7b8d863 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:41.409125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 717/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:43.471993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318b26-5e1b-48e6-979f-38e5856036a4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:43.472571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318b26-5e1b-48e6-979f-38e5856036a4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:43.472571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318b26-5e1b-48e6-979f-38e5856036a4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:43.473977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:43.479128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88235a0-a5d4-4609-a592-005143cfa500 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:43.479586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88235a0-a5d4-4609-a592-005143cfa500 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:43.479849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88235a0-a5d4-4609-a592-005143cfa500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:43.502127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e88235a0-a5d4-4609-a592-005143cfa500 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:43.503333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e88235a0-a5d4-4609-a592-005143cfa500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:43.511765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:43.548996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318b26-5e1b-48e6-979f-38e5856036a4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:43.560058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318b26-5e1b-48e6-979f-38e5856036a4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:43.563480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:43.564132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:43.564412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:43.564685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:43.573915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:43.575315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115ba5-1ede-49a3-9424-7889121be879 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:43.584458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 740/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:03:45.639311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bebf9b-cce8-448e-905a-e115b6ab1d05 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:45.639897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bebf9b-cce8-448e-905a-e115b6ab1d05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:45.639897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bebf9b-cce8-448e-905a-e115b6ab1d05 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:45.641286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:45.647040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6ce0-7d96-4f1c-9cf1-891217cae3c3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:45.647457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6ce0-7d96-4f1c-9cf1-891217cae3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:45.647587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6ce0-7d96-4f1c-9cf1-891217cae3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:45.669030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1dff6ce0-7d96-4f1c-9cf1-891217cae3c3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:45.670216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1dff6ce0-7d96-4f1c-9cf1-891217cae3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:45.677839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:45.714117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bebf9b-cce8-448e-905a-e115b6ab1d05 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:45.725409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bebf9b-cce8-448e-905a-e115b6ab1d05 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:45.728928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:45.729556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:45.729843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:45.730129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:45.740243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:45.741720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc3620-f38f-4fea-a417-231e7b513f15 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:45.753939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 720/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:47.829127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406fdf0-b59e-4b71-bf97-6e24b0e566cf None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:47.829719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406fdf0-b59e-4b71-bf97-6e24b0e566cf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:47.829719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406fdf0-b59e-4b71-bf97-6e24b0e566cf None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:47.831208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:47.836601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad332a-3cb0-42a7-b266-9d6da3661dd5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:47.836984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad332a-3cb0-42a7-b266-9d6da3661dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:47.837323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad332a-3cb0-42a7-b266-9d6da3661dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:47.843957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:47.858208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-98ad332a-3cb0-42a7-b266-9d6da3661dd5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:47.859389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-98ad332a-3cb0-42a7-b266-9d6da3661dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:47.867704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:47.905340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406fdf0-b59e-4b71-bf97-6e24b0e566cf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:47.911304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=73 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:03:47.917775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406fdf0-b59e-4b71-bf97-6e24b0e566cf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:47.921262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:47.921884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:47.922169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:47.922443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:47.931312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:47.932763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe209721-78dd-437c-a2bd-e8a050c437fc service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:47.942027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 743/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:50.030079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa46-2a4b-4a83-8e47-4a11b2df2a8d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:50.030618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa46-2a4b-4a83-8e47-4a11b2df2a8d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:50.030618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa46-2a4b-4a83-8e47-4a11b2df2a8d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:50.032087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:50.037363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407708b-cf71-416a-81b3-affc1ce3f7e3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:50.037811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407708b-cf71-416a-81b3-affc1ce3f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:50.037911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407708b-cf71-416a-81b3-affc1ce3f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:50.055406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4407708b-cf71-416a-81b3-affc1ce3f7e3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:50.056644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4407708b-cf71-416a-81b3-affc1ce3f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:50.064877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:50.105190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fa46-2a4b-4a83-8e47-4a11b2df2a8d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:50.116521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fa46-2a4b-4a83-8e47-4a11b2df2a8d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:50.120240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:50.120867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:50.121151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:50.121427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:50.130750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:50.132317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d963e-8e8c-4bee-bd14-075ffb5893d2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:50.141643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 723/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:03:52.186582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4e53-947f-4a9d-80c0-c78ea69e6014 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:52.187103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4e53-947f-4a9d-80c0-c78ea69e6014 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:52.187230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4e53-947f-4a9d-80c0-c78ea69e6014 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:52.188542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:03:52.193700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052aaa-daa0-4697-b9e1-4e607b85b493 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:52.194122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052aaa-daa0-4697-b9e1-4e607b85b493 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:52.194253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052aaa-daa0-4697-b9e1-4e607b85b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:52.211460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-38052aaa-daa0-4697-b9e1-4e607b85b493 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:03:52.212670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-38052aaa-daa0-4697-b9e1-4e607b85b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:03:52.220333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:03:52.257060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc4e53-947f-4a9d-80c0-c78ea69e6014 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:03:52.267503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc4e53-947f-4a9d-80c0-c78ea69e6014 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:03:52.270980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:03:52.271595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:03:52.271999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:03:52.272281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:03:52.281061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:03:52.282469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d10733-52e4-46f6-b166-ac8a3ebad9f4 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:03:52.292274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 746/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:02.207049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=11 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:04:02.288133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=14 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:04:12.024922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b037-fb5d-4358-97aa-c577352aee2d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:12.025538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b037-fb5d-4358-97aa-c577352aee2d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:12.025538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515b037-fb5d-4358-97aa-c577352aee2d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:12.026861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 725/1471] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:12.032279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f2a0-1ae8-41e4-99f1-79fd1265fcb3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:12.032821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f2a0-1ae8-41e4-99f1-79fd1265fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:12.032821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f2a0-1ae8-41e4-99f1-79fd1265fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:12.049903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-81e2f2a0-1ae8-41e4-99f1-79fd1265fcb3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:12.051080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-81e2f2a0-1ae8-41e4-99f1-79fd1265fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:12.058720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 747/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:12.106418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b65d1-1d8e-4415-a4d3-94ee4a879970 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:12.106710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b65d1-1d8e-4415-a4d3-94ee4a879970 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:12.106994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b65d1-1d8e-4415-a4d3-94ee4a879970 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:12.108430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 726/1473] 10.222.0.47 () {54 vars in 962 bytes} [Wed Jun 29 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:12.113098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13391-5eb4-483e-adf2-800e1e0a1abe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:12.113389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13391-5eb4-483e-adf2-800e1e0a1abe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:12.113665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13391-5eb4-483e-adf2-800e1e0a1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:12.131911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-00b13391-5eb4-483e-adf2-800e1e0a1abe None None] MFA Rules not processed for user `b3d302dfefab4d4a9cad2b67c3c70268`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:12.133085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-00b13391-5eb4-483e-adf2-800e1e0a1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:12.139382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 748/1474] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Jun 29 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:12.146866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b65d1-1d8e-4415-a4d3-94ee4a879970 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:12.157360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b65d1-1d8e-4415-a4d3-94ee4a879970 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:12.160898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:12.161514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:12.161799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:12.162076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:12.170837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:12.172336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04199ceb-2daa-4102-8883-0378edfe6fec service glance] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:12.181705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 727/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:04:14.308006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081666e-4006-48fc-86c8-fb21b1e07293 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:14.308608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081666e-4006-48fc-86c8-fb21b1e07293 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:14.308837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081666e-4006-48fc-86c8-fb21b1e07293 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:14.310214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 749/1476] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:14.316194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e011c6-385c-4c67-8ebb-7f6b5fce6a5c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:14.316718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e011c6-385c-4c67-8ebb-7f6b5fce6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:14.316816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e011c6-385c-4c67-8ebb-7f6b5fce6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:14.335648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b7e011c6-385c-4c67-8ebb-7f6b5fce6a5c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:14.336888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b7e011c6-385c-4c67-8ebb-7f6b5fce6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:14.344742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 728/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:14.368314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081666e-4006-48fc-86c8-fb21b1e07293 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:14.382230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081666e-4006-48fc-86c8-fb21b1e07293 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:14.386558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:14.387198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:14.387478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:14.387753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:14.388520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:14.390280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:04:14.390280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:04:14.390280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:04:14.391453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d96df-5332-40de-88fd-ca0f89796b87 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:14.412027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 750/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Jun 29 16:04:14 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:04:16.435873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414d95-8e77-4043-b1eb-99f7f386836b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:16.436404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414d95-8e77-4043-b1eb-99f7f386836b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:16.436404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c414d95-8e77-4043-b1eb-99f7f386836b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:16.437721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 729/1479] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:16.442905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755a66-57ac-4cdd-8820-52e0b419e276 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:16.443355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755a66-57ac-4cdd-8820-52e0b419e276 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:16.443461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db755a66-57ac-4cdd-8820-52e0b419e276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:16.461070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db755a66-57ac-4cdd-8820-52e0b419e276 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:16.462310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db755a66-57ac-4cdd-8820-52e0b419e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:16.469996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 751/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:16.513811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c414d95-8e77-4043-b1eb-99f7f386836b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:16.528466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c414d95-8e77-4043-b1eb-99f7f386836b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:16.534446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:16.535015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:16.535304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:16.535577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:16.544077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:16.545657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761fb0d-3370-4709-b696-e761aed4adae service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:16.555607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 730/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:18.750860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6e2b-927e-4043-bacc-7624ee61e72b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:18.751412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6e2b-927e-4043-bacc-7624ee61e72b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:18.751412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6e2b-927e-4043-bacc-7624ee61e72b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:18.753523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 752/1482] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:18.758409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6559-d7e1-4002-ba2a-79c3a0d6b319 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:18.758809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6559-d7e1-4002-ba2a-79c3a0d6b319 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:18.758965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb6559-d7e1-4002-ba2a-79c3a0d6b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:18.777116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b2cb6559-d7e1-4002-ba2a-79c3a0d6b319 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:18.778320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b2cb6559-d7e1-4002-ba2a-79c3a0d6b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:18.786183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 731/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:18.821795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d6e2b-927e-4043-bacc-7624ee61e72b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:18.833251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d6e2b-927e-4043-bacc-7624ee61e72b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:18.836721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:18.837340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:18.837618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:18.837892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:18.846713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:18.848141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4537a1f-0142-4b2e-9416-d6484afbb0a0 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:18.857331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 753/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:20.988338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbcb2-1a7a-409b-ab85-f829672b6ed8 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:20.988913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbcb2-1a7a-409b-ab85-f829672b6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:20.988913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcbcb2-1a7a-409b-ab85-f829672b6ed8 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:20.990263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 732/1485] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:20.995652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84bc-2e6d-4d76-9478-8f11ac69829d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:20.996133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84bc-2e6d-4d76-9478-8f11ac69829d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:20.996255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee84bc-2e6d-4d76-9478-8f11ac69829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:21.013791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-94ee84bc-2e6d-4d76-9478-8f11ac69829d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:21.014981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-94ee84bc-2e6d-4d76-9478-8f11ac69829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:21.022652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 754/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:21.060654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbcb2-1a7a-409b-ab85-f829672b6ed8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:21.071010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcbcb2-1a7a-409b-ab85-f829672b6ed8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:21.074451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:21.075107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:21.075390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:21.075663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:21.084645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:21.086065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314e9bc-948a-4371-8755-56587010b9e2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:21.095352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 733/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:23.245088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a2a-af19-4595-865a-c25da7f80a91 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:23.245619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a2a-af19-4595-865a-c25da7f80a91 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:23.245619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb9a2a-af19-4595-865a-c25da7f80a91 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:23.247026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 755/1488] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:23.252696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899500-8dec-4fd0-a709-1d797fae108e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:23.253096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899500-8dec-4fd0-a709-1d797fae108e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:23.253239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899500-8dec-4fd0-a709-1d797fae108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:23.270836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-88899500-8dec-4fd0-a709-1d797fae108e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:23.272046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-88899500-8dec-4fd0-a709-1d797fae108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:23.279558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 734/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:23.318960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb9a2a-af19-4595-865a-c25da7f80a91 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:23.329650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb9a2a-af19-4595-865a-c25da7f80a91 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:23.333749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:23.334382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:23.334668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:23.334947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:23.343748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:23.345171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb58d0-1a12-4b1a-a910-05bb8e6caf4a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:23.354702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 756/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:25.577596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc8f6-2938-4d64-b34f-c00c750386e9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:25.578166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc8f6-2938-4d64-b34f-c00c750386e9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:25.578166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dc8f6-2938-4d64-b34f-c00c750386e9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:25.579521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 735/1491] 10.222.0.47 () {54 vars in 926 bytes} [Wed Jun 29 16:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:04:25.584831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8daa2-e3d6-449e-a7be-c25decf58eb1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:25.585300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8daa2-e3d6-449e-a7be-c25decf58eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:25.585408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8daa2-e3d6-449e-a7be-c25decf58eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:25.603541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7ef8daa2-e3d6-449e-a7be-c25decf58eb1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:04:25.605349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7ef8daa2-e3d6-449e-a7be-c25decf58eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:04:25.615103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 757/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Wed Jun 29 16:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:04:25.657658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc8f6-2938-4d64-b34f-c00c750386e9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:04:25.668681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dc8f6-2938-4d64-b34f-c00c750386e9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:04:25.672123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:04:25.672745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:04:25.673027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:04:25.673301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:04:25.682605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:04:25.684057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9010fd-df89-4f9a-9136-55d6d3f1707d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:04:25.693418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 736/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:04:35.598069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=33 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:04:35.689192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=33 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:06:03.214977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.215534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.215534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.233591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:06:03.234782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:03.242813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 758/1494] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:06:03.251100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.251563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.251665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.268950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:06:03.270122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:03.277710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 737/1495] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:06:03.282089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.291455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aec5b7-c06f-48cb-a119-24bec670a0c7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.296659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.297292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.297574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.297848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.298562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:06:03.298867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.299889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.299889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:06:03.299889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:06:03.301069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.313177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 759/1496] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:06:03.320767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.329647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76cee-1889-425b-9364-577c2656b232 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.334088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.334714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.334992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.335263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.335973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.337775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.337775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:06:03.337775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:06:03.338899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.378988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 738/1497] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:06:03.383224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.393444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39241de-2ab1-4713-814d-63d942861d07 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.450994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.451654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.451962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.452238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.452926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.453918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.453918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:06:03.453918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:06:03.455092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.474052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 760/1498] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:06:03.478138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.488990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4b27-b76d-46d5-9cb9-0dc19687626e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.493767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.494417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.494700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.494978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.495729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.496777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.496777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:06:03.496777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:06:03.497653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.510154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 739/1499] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:06:03.514348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.524144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbf129-ca0d-4ac9-80c1-a25341b521b3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.529184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.529815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.530096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.530370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.531085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.532112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.532112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:06:03.532112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:06:03.532981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05e40d-df10-47b0-8de7-799853e0fa12 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.550383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 761/1500] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:06:03.554630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.564747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165de7-4ca0-4ac7-be49-87c7f80323a1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.569205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.570077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.570360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.570633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] PATH_INFO: `/v3/projects/85bbd60a342645e1aa3ad99b50e2c7cc/users/573143c995b94301b30a7c3e7e40e7bf/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.585271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bbd60a342645e1aa3ad99b50e2c7cc, user_id=573143c995b94301b30a7c3e7e40e7bf, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.586289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.586289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:06:03.586289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:06:03.588282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3336-74bb-4bfb-b199-dcce507e92bd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.601157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 740/1501] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:06:03 2022] PUT /identity/v3/projects/85bbd60a342645e1aa3ad99b50e2c7cc/users/573143c995b94301b30a7c3e7e40e7bf/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:06:03.613818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82a6d-636a-44b9-817b-8762fd18ffd6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.614108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82a6d-636a-44b9-817b-8762fd18ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.614382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82a6d-636a-44b9-817b-8762fd18ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.640068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-afe82a6d-636a-44b9-817b-8762fd18ffd6 None None] MFA Rules not processed for user `573143c995b94301b30a7c3e7e40e7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:06:03.641258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-afe82a6d-636a-44b9-817b-8762fd18ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:03.702887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 762/1502] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:06:03.715803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13aa50-9538-4c7f-8911-6878ddefdbef None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.716124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13aa50-9538-4c7f-8911-6878ddefdbef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.717008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13aa50-9538-4c7f-8911-6878ddefdbef None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.718347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 741/1503] 10.222.0.47 () {54 vars in 963 bytes} [Wed Jun 29 16:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:06:03.723045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcac0-3932-4bcb-b676-7578022853cc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.723338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcac0-3932-4bcb-b676-7578022853cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.723641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcac0-3932-4bcb-b676-7578022853cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.740744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ceffcac0-3932-4bcb-b676-7578022853cc None None] MFA Rules not processed for user `8402cadd9aac46518a45b01b18ef1965`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:06:03.741924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ceffcac0-3932-4bcb-b676-7578022853cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:03.783839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:06:03.792172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 763/1504] 10.222.0.47 () {58 vars in 1060 bytes} [Wed Jun 29 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:06:03.799731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13aa50-9538-4c7f-8911-6878ddefdbef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.810138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13aa50-9538-4c7f-8911-6878ddefdbef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.813639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.814293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.814574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.814845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.822919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.824378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:03.833492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 742/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:06:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:06:03.877671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04207d5-8be3-4ef8-8849-12bf647f2a65 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.877961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04207d5-8be3-4ef8-8849-12bf647f2a65 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.878238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04207d5-8be3-4ef8-8849-12bf647f2a65 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.879527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 764/1506] 10.222.0.47 () {52 vars in 829 bytes} [Wed Jun 29 16:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:06:03.883118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:03.943270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6719e-eda9-431a-9c9b-c0fe322ff926 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:03.947682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:03.948582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:03.948864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:03.949134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] PATH_INFO: `/v3/users/573143c995b94301b30a7c3e7e40e7bf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:03.950303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573143c995b94301b30a7c3e7e40e7bf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:03.951884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:03.951884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:06:03.951884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:06:03.953075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:04.016249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573143c995b94301b30a7c3e7e40e7bf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.025358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573143c995b94301b30a7c3e7e40e7bf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.026073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573143c995b94301b30a7c3e7e40e7bf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.038797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573143c995b94301b30a7c3e7e40e7bf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.054599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:06:04.057222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573143c995b94301b30a7c3e7e40e7bf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.064775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 743/1507] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:06:03 2022] DELETE /identity/v3/users/573143c995b94301b30a7c3e7e40e7bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:06:04.069117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:04.069409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:04.069698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:04.087601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:06:04.088640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:04.147943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 765/1508] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:06:04.157314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:04.158702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:04.217011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d17ea9-ac8c-460d-8d0b-8298a4fcfd60 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:04.223585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:04.224714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:04.225273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:04.225755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:04.238736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:04.240225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585bd24-277e-4eb5-b408-233c4de40a5c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:04.250265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 744/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:06:04.598418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:06:04.599784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:06:04.612420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fbd49-a4cc-427d-b4c1-ee566e115269 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:06:04.617082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:06:04.618113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:06:04.618394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:06:04.618666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] PATH_INFO: `/v3/projects/85bbd60a342645e1aa3ad99b50e2c7cc` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:06:04.621225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bbd60a342645e1aa3ad99b50e2c7cc)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:06:04.622256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:06:04.622256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:06:04.622256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:06:04.624089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:06:04.682482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bbd60a342645e1aa3ad99b50e2c7cc', 'request_id': 'req-0e9ab591-e6e3-467b-ba4c-19808a13e555'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.692163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bbd60a342645e1aa3ad99b50e2c7cc', 'request_id': 'req-0e9ab591-e6e3-467b-ba4c-19808a13e555'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.705363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bbd60a342645e1aa3ad99b50e2c7cc', 'request_id': 'req-0e9ab591-e6e3-467b-ba4c-19808a13e555'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.716039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] The token cache is being invalidate because project 85bbd60a342645e1aa3ad99b50e2c7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:06:04.716352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.716984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e9ab591-e6e3-467b-ba4c-19808a13e555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:06:04.718599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 766/1510] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:06:04 2022] DELETE /identity/v3/projects/85bbd60a342645e1aa3ad99b50e2c7cc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:06:14.245635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:06:14.713142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:42.929314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:42.929888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:42.929888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:42.931168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:07:42.936867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4a1-9033-46b6-9300-183629545036 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:42.937347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4a1-9033-46b6-9300-183629545036 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:42.937479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4a1-9033-46b6-9300-183629545036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:42.955478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bbf2b4a1-9033-46b6-9300-183629545036 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:42.956924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bbf2b4a1-9033-46b6-9300-183629545036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:43.016901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:07:43.170863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:07:43.172551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:43.246064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7fee-4746-46e0-bbac-4679e9faf400 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:07:43.251429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:07:43.252091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:43.252375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:43.252648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:43.260687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:07:43.262263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a497fe7-3a1d-4bca-80cd-81eaf65b4ee7 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:07:43.271541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 746/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:07:44.102977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e01be-ea33-46cd-88bf-d08b8f85138d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:44.103436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e01be-ea33-46cd-88bf-d08b8f85138d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:44.103542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e01be-ea33-46cd-88bf-d08b8f85138d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:44.105053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:07:44.110638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d655c-76fd-4345-98b0-a36606735508 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:44.111060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d655c-76fd-4345-98b0-a36606735508 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:44.111199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d655c-76fd-4345-98b0-a36606735508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:44.129103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ed8d655c-76fd-4345-98b0-a36606735508 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:44.130308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ed8d655c-76fd-4345-98b0-a36606735508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:44.137995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:07:44.290517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e01be-ea33-46cd-88bf-d08b8f85138d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:07:44.304655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e01be-ea33-46cd-88bf-d08b8f85138d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:07:44.309924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:07:44.310586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:44.310872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:44.311149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:44.319076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:07:44.320689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954893-e773-4fef-a44f-310910755d5c service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:07:44.330783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 769/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:07:45.197721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ad19-0f9f-4d61-895e-bd9aa6451176 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:45.198359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ad19-0f9f-4d61-895e-bd9aa6451176 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:45.198359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4ad19-0f9f-4d61-895e-bd9aa6451176 None None] PATH_INFO: `/v3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:45.199562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 748/1517] 10.222.0.57 () {54 vars in 925 bytes} [Wed Jun 29 16:07:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:07:45.205671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df728e-6e0f-4d74-960e-1b137338abd2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:45.206105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df728e-6e0f-4d74-960e-1b137338abd2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:45.206212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df728e-6e0f-4d74-960e-1b137338abd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:45.223731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-00df728e-6e0f-4d74-960e-1b137338abd2 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:45.225039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-00df728e-6e0f-4d74-960e-1b137338abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:45.292125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 770/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Jun 29 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:07:54.124171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=37 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:07:54.267762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28ba3-5e82-43bf-b2f8-40cabc6e0c89 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:54.268087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28ba3-5e82-43bf-b2f8-40cabc6e0c89 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:54.268371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28ba3-5e82-43bf-b2f8-40cabc6e0c89 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:54.269771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 749/1519] 10.222.0.47 () {54 vars in 960 bytes} [Wed Jun 29 16:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:07:54.274815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca47dc-120c-4d51-afb0-2ce14752f514 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:54.275268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca47dc-120c-4d51-afb0-2ce14752f514 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:54.275379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca47dc-120c-4d51-afb0-2ce14752f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:54.293290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a5ca47dc-120c-4d51-afb0-2ce14752f514 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:54.295157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a5ca47dc-120c-4d51-afb0-2ce14752f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:54.303971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 771/1520] 10.222.0.47 () {58 vars in 1057 bytes} [Wed Jun 29 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:07:54.311728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28ba3-5e82-43bf-b2f8-40cabc6e0c89 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:07:54.324938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28ba3-5e82-43bf-b2f8-40cabc6e0c89 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:07:54.329773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:07:54.330401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:54.330681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:54.330957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:54.338975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:07:54.340573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f5eea-6560-4f2c-bcd1-869ea803bd8f service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:07:54.351744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 750/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:07:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:07:55.559472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e532e6-578a-4e4f-b771-fecbdfb60ff4 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:55.560609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e532e6-578a-4e4f-b771-fecbdfb60ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:55.560609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e532e6-578a-4e4f-b771-fecbdfb60ff4 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:55.562044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:07:55.566884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f538-b03a-4e88-a59a-c5b0d557e3b2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:55.567297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f538-b03a-4e88-a59a-c5b0d557e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:55.567440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677f538-b03a-4e88-a59a-c5b0d557e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:55.584922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c677f538-b03a-4e88-a59a-c5b0d557e3b2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:55.586110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c677f538-b03a-4e88-a59a-c5b0d557e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:55.593866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:07:55.745353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e532e6-578a-4e4f-b771-fecbdfb60ff4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:07:55.760237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e532e6-578a-4e4f-b771-fecbdfb60ff4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:07:55.765584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:07:55.766208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:55.766492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:55.766768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:55.774909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:07:55.776539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba337-0f0c-4aed-b896-b5d3bba7b3a8 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:07:55.786448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 773/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:07:56.603525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892d95-6f2f-4feb-9452-a68b5ed15f0f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:56.604120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892d95-6f2f-4feb-9452-a68b5ed15f0f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:56.604120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69892d95-6f2f-4feb-9452-a68b5ed15f0f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:56.605461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 16:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:07:56.610193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ccea-3947-4cf0-9629-627af267274b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:56.610643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ccea-3947-4cf0-9629-627af267274b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:56.610748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ccea-3947-4cf0-9629-627af267274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:56.630025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ecc6ccea-3947-4cf0-9629-627af267274b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:07:56.631224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ecc6ccea-3947-4cf0-9629-627af267274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:07:56.640306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:07:56.789966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892d95-6f2f-4feb-9452-a68b5ed15f0f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:07:56.803937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69892d95-6f2f-4feb-9452-a68b5ed15f0f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:07:56.809257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:07:56.809877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:07:56.810693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:07:56.810966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:07:56.818881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:07:56.820485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7969f20-464d-4f6a-adfd-2456da7fd93c service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:07:56.830521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 753/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:08:00.744312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:00.744879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:00.744879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:00.746275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:08:00.751685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d636-4227-417d-98c0-116247f7fbac None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:00.752145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d636-4227-417d-98c0-116247f7fbac None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:00.752305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213d636-4227-417d-98c0-116247f7fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:00.772697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2213d636-4227-417d-98c0-116247f7fbac None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:08:00.773891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2213d636-4227-417d-98c0-116247f7fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:00.782260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:08:00.818263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:08:00.819976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:00.876535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908bad0-b30b-4896-a8ec-5e5d194b52a2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:08:00.880053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:08:00.880691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:00.880983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:00.881262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:00.890579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:08:00.892027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cd10b-45b9-4c70-99e7-2fac98a4d833 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:08:00.896859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:08:00.901839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 776/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:08:02.918648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032af20-f5f3-4041-a517-6a1bc4c327d5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:02.919720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032af20-f5f3-4041-a517-6a1bc4c327d5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:02.919720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032af20-f5f3-4041-a517-6a1bc4c327d5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:02.921024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:08:02.926196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9386-c538-4d0d-912f-59da2c133d5a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:02.926615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9386-c538-4d0d-912f-59da2c133d5a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:02.926757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9386-c538-4d0d-912f-59da2c133d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:02.945131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-db4c9386-c538-4d0d-912f-59da2c133d5a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:08:02.946329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-db4c9386-c538-4d0d-912f-59da2c133d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:02.954117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:08:02.989863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032af20-f5f3-4041-a517-6a1bc4c327d5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:08:03.001187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032af20-f5f3-4041-a517-6a1bc4c327d5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:08:03.004653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:08:03.005273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:03.005551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:03.005822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:03.014615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:08:03.016059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b542f-e1bb-4618-87b2-2237cb587795 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:08:03.025176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 756/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:08:06.472118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:06.472638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:06.472638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:06.473973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:08:06.480734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86faf-b63f-4178-b1b7-cd79b2513e48 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:06.481157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86faf-b63f-4178-b1b7-cd79b2513e48 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:06.481294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86faf-b63f-4178-b1b7-cd79b2513e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:06.500008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f8d86faf-b63f-4178-b1b7-cd79b2513e48 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:08:06.501195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8d86faf-b63f-4178-b1b7-cd79b2513e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:06.508889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:08:06.808646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:08:06.810895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:06.868364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f7ca-1577-4aa2-9e9b-ff7ac0b2d2db None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:08:06.871951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:08:06.873214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:06.873494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:06.873767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:06.882519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:08:06.883945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998ff18-000d-432d-925f-7f5d535e2283 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:08:06.893196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 779/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:08:08.951791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:08.952441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:08.952441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:08.953702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 16:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:08:08.958919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981608-d134-4855-b8ad-6620c35cb3fd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:08.959350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981608-d134-4855-b8ad-6620c35cb3fd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:08.959453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4981608-d134-4855-b8ad-6620c35cb3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:08.976520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d4981608-d134-4855-b8ad-6620c35cb3fd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:08:08.977708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d4981608-d134-4855-b8ad-6620c35cb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:08.985799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 16:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:08:09.283688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:08:09.285453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:08:09.298860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68def4b3-cdfc-4958-84dd-0e89783ee922 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:08:09.302365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:08:09.302992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:08:09.303275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:08:09.303548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:08:09.312468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:08:09.313887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3417b-d2fe-42a3-8548-3891489b96c2 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:08:09.323315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 759/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:08:18.971920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:08:19.319078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=33 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:38.903507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:38.904644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:38.905157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:38.933377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:38.935111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:38.949205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 781/1540] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:38.958545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8c625-f8b8-46d8-bd63-b61ddb471914 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:38.959201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8c625-f8b8-46d8-bd63-b61ddb471914 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:38.959201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8c625-f8b8-46d8-bd63-b61ddb471914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:38.988835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-20e8c625-f8b8-46d8-bd63-b61ddb471914 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:38.990060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-20e8c625-f8b8-46d8-bd63-b61ddb471914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.003171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 760/1541] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.007608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.018567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6894bb9-6008-4f0a-9460-37ed0258d6ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.029964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.031101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.031621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.032141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.033124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.033660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.035861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.042346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9c3-6a93-4d84-ad53-009e9d2f0c05 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.042680 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9c3-6a93-4d84-ad53-009e9d2f0c05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.042922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9c3-6a93-4d84-ad53-009e9d2f0c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.057108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 782/1542] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.069174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.074870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4defe9c3-6a93-4d84-ad53-009e9d2f0c05 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.076117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4defe9c3-6a93-4d84-ad53-009e9d2f0c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.085532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed38e09-ee0c-4f77-a564-62546fcd472f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.097233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.098319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.099101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.099623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.100595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.102107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:39.102107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:09:39.102107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:09:39.104424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecab0d-d1fa-4360-9a33-95aace3e204a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.110454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 761/1543] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.118367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.118702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.119125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.152963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.154102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.163636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 783/1544] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:09:39.167902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 762/1545] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.168645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d40f-77aa-42fc-87a4-331c89cf0c6f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.168773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.169414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d40f-77aa-42fc-87a4-331c89cf0c6f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.169931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d40f-77aa-42fc-87a4-331c89cf0c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.180045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c76dbd-1071-488d-9f84-4781fa13f709 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.208866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca42d40f-77aa-42fc-87a4-331c89cf0c6f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.210199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca42d40f-77aa-42fc-87a4-331c89cf0c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.257637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.258319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.258600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.261236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.261619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.262654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:39.262654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:09:39.262654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:09:39.265772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.310998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 763/1546] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.312197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.323339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 784/1547] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:09:39.323339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251ed1-fcc2-4161-b397-b6efdee7cde3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.323339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251ed1-fcc2-4161-b397-b6efdee7cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.323339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251ed1-fcc2-4161-b397-b6efdee7cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.329330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2eed15-28e5-4b68-92cc-b53cc66a2db2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.334606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.335674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.336308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.336813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.337885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.338530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.339860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:39.339860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:09:39.339860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:09:39.341234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca034-5757-4088-aa2f-e32ba26b62d9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.352906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee251ed1-fcc2-4161-b397-b6efdee7cde3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.353974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee251ed1-fcc2-4161-b397-b6efdee7cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.357359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 764/1548] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.359781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.360336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.360834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.363800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 785/1549] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.365121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49eaba-0d30-44f8-8d34-69daef8bd125 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.365405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49eaba-0d30-44f8-8d34-69daef8bd125 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.365928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49eaba-0d30-44f8-8d34-69daef8bd125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.382138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.383775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.386508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee49eaba-0d30-44f8-8d34-69daef8bd125 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.387864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee49eaba-0d30-44f8-8d34-69daef8bd125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.393621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 765/1550] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.395863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.403698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 786/1551] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.404898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.405192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.405472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.418993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f36ce-6555-45a7-bcbb-80754e2eee58 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.424312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.424975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.425255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.425526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.426248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.427884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9db7b-bb62-4868-9cbd-a25d17e11303 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.431681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.432909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.438343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 766/1552] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:39.439562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7205-1dfa-47df-be20-3959a98cf96d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.439867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7205-1dfa-47df-be20-3959a98cf96d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.440148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7205-1dfa-47df-be20-3959a98cf96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.442620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 787/1553] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.442620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.453113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9434efc-661f-482a-9206-44c831ea1f23 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.457608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.458055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1c1c7205-1dfa-47df-be20-3959a98cf96d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.458236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.458520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.458796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.459251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1c1c7205-1dfa-47df-be20-3959a98cf96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.459478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.461586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59b79f-a74d-4dff-b151-653ca2643122 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.467120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 767/1554] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.468411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9e6a-f5e1-48fc-85f6-00699b9dce05 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.469261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9e6a-f5e1-48fc-85f6-00699b9dce05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.469514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9e6a-f5e1-48fc-85f6-00699b9dce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.488919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a74c9e6a-f5e1-48fc-85f6-00699b9dce05 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.489125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 788/1555] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.490117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a74c9e6a-f5e1-48fc-85f6-00699b9dce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.490390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4316e-a2c7-4f0c-9dee-2d459ab6166f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.490681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4316e-a2c7-4f0c-9dee-2d459ab6166f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.490963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4316e-a2c7-4f0c-9dee-2d459ab6166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.508498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f7e4316e-a2c7-4f0c-9dee-2d459ab6166f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.509670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7e4316e-a2c7-4f0c-9dee-2d459ab6166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.552476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 768/1556] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.553762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.554060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.554338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.571195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 789/1557] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.571563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.572722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.572854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.573006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.573283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.581683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 769/1558] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.582684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.592218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa06b-b55e-4dee-8817-9057040fa09a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.596296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.597322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.597478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.597969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.598252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.598526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.599243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.600868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.605285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 790/1559] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.606135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.611457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 770/1560] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:39.612515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.618337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a20f6-151f-4e0d-89b6-5649a3259914 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.622237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01ab6-55fc-4853-bcc4-7206bf3deec5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.623768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.624503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.624809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.625205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.625933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.626243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.626992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.627630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.627918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.628031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.628219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.628934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.629238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.630806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.634828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:39.641884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 791/1561] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.643019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.644387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 771/1562] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.645366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.651004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:39.654476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e539-a40f-471a-a676-a3104f17922b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.656800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485972-d8b5-4739-99a0-695eba55233c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.660251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.660924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.661216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.661522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.662213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.664152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.665100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.665931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.666212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.666488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.667223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.667532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.669165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c22f-a61f-4669-afc5-b0e83b1c40af admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.683378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 772/1563] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.684712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6433-cdb0-4e6a-8d2d-776eec853b72 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.685001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6433-cdb0-4e6a-8d2d-776eec853b72 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.685283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b6433-cdb0-4e6a-8d2d-776eec853b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.690603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 792/1564] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.691597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.701510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea1b0-2f09-478a-8045-98b3cc995b5b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.704686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a44b6433-cdb0-4e6a-8d2d-776eec853b72 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.705908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a44b6433-cdb0-4e6a-8d2d-776eec853b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.708612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.709294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.709579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.709855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.710580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:39.710886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.712557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.714039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 773/1565] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.715256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.715543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.715842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.733661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 793/1566] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:39.733661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.739306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348fb18-ea05-4312-8a57-8f249184f988 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.739943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:39.741151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:39.743867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.745000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.745278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.745553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] PATH_INFO: `/v3/projects/a0add8dd81ce48dda51cbca71cd875d5/users/ba6701e26058440fa098a6a0e9da7f1a/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.749294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 774/1567] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:39.753527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.760892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0add8dd81ce48dda51cbca71cd875d5, user_id=ba6701e26058440fa098a6a0e9da7f1a, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.762074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:39.762074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:09:39.762074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:09:39.762951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302b81d-4f8e-44a2-bb4d-f3a21eff8ef9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.764050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.768112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.768804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.769404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.769770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.770883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.772992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.777551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 794/1568] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:39 2022] PUT /identity/v3/projects/a0add8dd81ce48dda51cbca71cd875d5/users/ba6701e26058440fa098a6a0e9da7f1a/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:39.778386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.802818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 775/1569] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.802818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.844549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa031-ef66-40d7-bd72-ca487ced0607 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.865840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeb95d-dd73-4236-8b5b-6c424558b9ed admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.871120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.871777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.872093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.872375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.873064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.875025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.900777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:39.901473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:39.901773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:39.902032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:39.902489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 776/1570] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.902733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:39.903373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.904653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:39.935758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 795/1571] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:39.935758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:39.968884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e4f2-b5e8-4e81-82a4-400f94ebbb78 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:39.972189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:39.996995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60979b41-5ed3-4c32-97ed-da84a32343e9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.002287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.002942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.003222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.003496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.004243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:40.004549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.006114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.013466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:40.018547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 796/1572] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:40.021116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.029710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.030586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.030873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.031713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.032488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.034124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.034861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b40a0-e685-49a5-95b9-cf465c51e916 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.039525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.040200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.040486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.040770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.041469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.043328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abffa45-4d58-46f4-820e-010c5e96c5b9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.044122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 777/1573] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.047890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.057777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdca83-5a2d-4e69-835c-39f9f0c5cb6a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.063100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.063754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.064072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.064351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.065071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:40.065380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.066973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.070569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 797/1574] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.071969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.072259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.072532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.083859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 778/1575] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:40.083859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.095428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517919d4-0e90-4670-8314-930e9946e5a6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.096279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:40.097568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:40.156854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.157533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.157837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.158121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.158811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.160450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 798/1576] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:40.161961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.165227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.176433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398739f-1f58-4b4f-a5a9-1e92c04ecc91 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.184038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.185003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.189664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 779/1577] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.189836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.189836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.190035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.190133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.191812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.200528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c7e72-008c-44d4-99a7-23905503d1d8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.207743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.208454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.208719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.208993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.209702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.211952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.215008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 799/1578] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.215008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.227494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d5d2-a92f-4a48-9540-2b4416b17029 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.234584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 780/1579] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.234584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.235505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.236181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.236463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.236792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.237478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.239355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.241859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11340a-f21f-47c0-bb11-8f3f40831818 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.247296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.247989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.248709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.248998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.250243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.252348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.263296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 781/1580] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.264100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.271229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 800/1581] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.271229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.277298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1628-ff05-4af4-a5bb-ad87d4fbf8ef admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.331712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c307d-c073-466f-9fa5-c5876c332cc3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.336857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.337556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.337837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.338113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.338688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.338811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.339364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.339651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.339975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.340664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.340771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.342586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.355703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:40.363753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 782/1582] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.364877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.376813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 801/1583] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.376813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.389469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:40.424330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00d1-c6e3-45d5-849e-437495cc5e45 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.434478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87ec6-d18c-40d4-b169-56023bad20e7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.439726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.440453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.440737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.441012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.441755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.443326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.453180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 802/1584] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.453180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.463203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300f36-caa9-4b65-bd7e-095aa22cc9ab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.467719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.468384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.468699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.468979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.469693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.471259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.475832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.476494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.476780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.477053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.481212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 803/1585] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.481997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.487167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.488560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.491641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357ac6-0556-4a4b-9814-5c1b329ad10d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.496523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.497149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.497433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.497711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.498374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 783/1586] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:40.498533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.499223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.500535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.510033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb93ef-6c2e-4d2a-a2fa-b6c159e58808 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.511666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 804/1587] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.512336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.517827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.518888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.519175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.519452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] PATH_INFO: `/v3/projects/3910745b858045628982687e473c23b7/users/d75d976f2c554209bc4c64d338ad7cf7/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.522761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafe30-a7e4-4b57-8726-035ec53e6466 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.527615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.528319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.528611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.528884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.529715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.531807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.536003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3910745b858045628982687e473c23b7, user_id=d75d976f2c554209bc4c64d338ad7cf7, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.538672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.553745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 784/1588] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:40 2022] PUT /identity/v3/projects/3910745b858045628982687e473c23b7/users/d75d976f2c554209bc4c64d338ad7cf7/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:40.554323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.558694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 805/1589] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.559781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.570908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679b2db-ea6e-46cd-8fe0-6f172c50f81e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.631479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9519b-7b70-4d59-8b30-6b70bbe23431 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.636886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.637423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.637706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.637978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.638106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.638246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.638429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.638550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.639212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.639342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.640943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.641332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.658602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 785/1590] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.659978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.667734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 806/1591] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:40.667734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.674323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef4eff-8ae3-4ce5-af10-921ef1d1c960 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.677146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d7-5c0f-4f34-871c-252e705ad9fb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.680519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.681404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.681755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.682096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.682515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.682827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.683210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.683496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.683775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.684453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.684575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.686359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc63f65-bfea-4bf3-a6a1-1b05ca2f0776 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.703460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 786/1592] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.703460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.703650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 807/1593] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.703650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.703650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.703650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.717449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4492cc-013a-4668-b00b-5f9fabd279de admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.723648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.724461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.724811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.725183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.725978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.727686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.731048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:40.732984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:40.739710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 787/1594] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.740513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.742118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 808/1595] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:40.743009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.750972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a49050-4518-4fa1-88ea-33f00d4729da admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.755805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.756281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1ac7-7bfd-41b5-aca1-f996907624f7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.756824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.757206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.757578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.758396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.760116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.761135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.761794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.762076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.762353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.763081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.764703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.772283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 788/1596] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.773100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.775773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 809/1597] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.776729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.788116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e13118-1ad5-49a8-ab9c-f762c37fc27c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.788374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634775-1ed3-4a1e-b491-7dafd0bc4fac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.792928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.793592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.793732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.793927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.794208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.794829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.794926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.795778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.796345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] PATH_INFO: `/v3/projects/2c817ebe7ac040be9c2f0a63d8a86dfa/users/2e88276aba204eeb8af05590f7904d5d/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.796548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.807716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:40.812145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 789/1598] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:40.813278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.818667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c817ebe7ac040be9c2f0a63d8a86dfa, user_id=2e88276aba204eeb8af05590f7904d5d, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.823226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.826762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd96fe-53cc-410d-8ec9-ed035393b087 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.834649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.836046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.836315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.837117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] PATH_INFO: `/v3/projects/3fa6a9273bf24c67bfc20849da531320/users/5b45e8b15637406eb145ca6e756e1f44/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:40.840869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:40.843999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 810/1599] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:40 2022] PUT /identity/v3/projects/2c817ebe7ac040be9c2f0a63d8a86dfa/users/2e88276aba204eeb8af05590f7904d5d/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:40.852012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.859098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa6a9273bf24c67bfc20849da531320, user_id=5b45e8b15637406eb145ca6e756e1f44, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:40.863694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:40.880758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 790/1600] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:40 2022] PUT /identity/v3/projects/3fa6a9273bf24c67bfc20849da531320/users/5b45e8b15637406eb145ca6e756e1f44/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:40.881940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:40.883861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:40.946987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef1e3-2bb1-40e4-a479-fe14e0f86892 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.959468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d814-f812-4c2f-8d40-69b9cb134c1e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:40.964951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:40.966665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:40.967125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:40.967640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.012879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.014131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.014424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.014704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] PATH_INFO: `/v3/projects/6a410f5a9cef44b39a657b28f6c1772b/users/1c00db02926f4d849249c3990fdf8308/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.034192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a410f5a9cef44b39a657b28f6c1772b, user_id=1c00db02926f4d849249c3990fdf8308, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.037416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.054457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.055078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 811/1601] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:40 2022] PUT /identity/v3/projects/6a410f5a9cef44b39a657b28f6c1772b/users/1c00db02926f4d849249c3990fdf8308/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:41.056069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.057394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.069711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 791/1602] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:41.070597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.085693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0fc9d-18ea-4bfb-9d5f-8624e1e7e218 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.152320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da56054-2a48-4151-9584-19cea6b766d8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.158251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.158925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.159694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.159694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.160275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.161873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.165973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.167749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.167749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.167749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] PATH_INFO: `/v3/projects/f81b8fe398ae4ed19d6b9f49f6490e5a/users/2020c486ef3e4fceb1d671269668ba68/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.173272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 812/1603] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:41.174151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.183973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81b8fe398ae4ed19d6b9f49f6490e5a, user_id=2020c486ef3e4fceb1d671269668ba68, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.184237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d5098-30e3-4808-98f3-ab03addb8f9e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.186780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9d62e-d252-4b2b-a808-efb304f95f21 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.190294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.191041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.191426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.191611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.192379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.193980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6f08e-c6b0-4d45-b2c2-57ac59b6b880 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.203891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 792/1604] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:41 2022] PUT /identity/v3/projects/f81b8fe398ae4ed19d6b9f49f6490e5a/users/2020c486ef3e4fceb1d671269668ba68/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:41.205827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.209054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 813/1605] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:41.209231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.209231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.210187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a256f-7b2a-4c77-9c47-c320e55480d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.210516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a256f-7b2a-4c77-9c47-c320e55480d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.210803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a256f-7b2a-4c77-9c47-c320e55480d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.216583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.228461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1c9a256f-7b2a-4c77-9c47-c320e55480d9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.230807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c9a256f-7b2a-4c77-9c47-c320e55480d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.239381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] MFA Rules not processed for user `2e88276aba204eeb8af05590f7904d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.240889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.246217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.299891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 814/1606] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:41.301535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924eb3-e701-4eda-bb23-8cc9779bc394 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.301988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924eb3-e701-4eda-bb23-8cc9779bc394 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.302407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924eb3-e701-4eda-bb23-8cc9779bc394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.323720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 793/1607] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:41.324715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.333522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e924eb3-e701-4eda-bb23-8cc9779bc394 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.335214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e924eb3-e701-4eda-bb23-8cc9779bc394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.339864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8552659-32a0-43e4-b901-510a5133d9dc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.342949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 815/1608] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:41.345713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3860-a770-490d-b378-081120941d17 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.346167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3860-a770-490d-b378-081120941d17 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.346698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3860-a770-490d-b378-081120941d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.347367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.348666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.349148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.349593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] PATH_INFO: `/v3/projects/8e5ae05750a0464b80b73aefe24d0e9a/users/680a55dbab784e2d85b74a972d3bdac9/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.371225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5ae05750a0464b80b73aefe24d0e9a, user_id=680a55dbab784e2d85b74a972d3bdac9, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.377309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.383290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-669e3860-a770-490d-b378-081120941d17 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.385312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-669e3860-a770-490d-b378-081120941d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.400959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 816/1609] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:41.402028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e3860-a770-490d-b378-081120941d17 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.416710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e3860-a770-490d-b378-081120941d17 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.427023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 794/1610] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:41 2022] PUT /identity/v3/projects/8e5ae05750a0464b80b73aefe24d0e9a/users/680a55dbab784e2d85b74a972d3bdac9/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:41.427771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.536156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.537456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.537850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.538237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] PATH_INFO: `/v3/projects/746d8195d5634783bbd1d0a4400aaf89/users/7c34e756151b4d95a0b013200a0ccb71/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.558203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b024-0105-453d-8476-d224ed3e263b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.562359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.563037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.563325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.563600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.576088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.576836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] RBAC: Authorizing `identity:create_grant(project_id=746d8195d5634783bbd1d0a4400aaf89, user_id=7c34e756151b4d95a0b013200a0ccb71, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.577612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.579963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1ddd-0afa-4ccd-b243-aed1884292de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.590081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 795/1611] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:41.591239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.602069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5643af9-1e04-4264-91a5-9aec7c861c2f service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.615896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 817/1612] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:41 2022] PUT /identity/v3/projects/746d8195d5634783bbd1d0a4400aaf89/users/7c34e756151b4d95a0b013200a0ccb71/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:41.617461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f71af3-d700-4b94-ab31-cd5c052be223 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.621124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f71af3-d700-4b94-ab31-cd5c052be223 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.621557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f71af3-d700-4b94-ab31-cd5c052be223 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.627176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 818/1613] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jun 29 16:09:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:09:41.629273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f55a5d-bd54-45ba-bf32-ab62839cb573 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.631413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f55a5d-bd54-45ba-bf32-ab62839cb573 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.631956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f55a5d-bd54-45ba-bf32-ab62839cb573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.681477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.682143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.682425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.682698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.717452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-85f55a5d-bd54-45ba-bf32-ab62839cb573 None None] MFA Rules not processed for user `680a55dbab784e2d85b74a972d3bdac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.720098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-85f55a5d-bd54-45ba-bf32-ab62839cb573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.735464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.773435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.775081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.789657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 796/1614] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:41.789657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:41.804614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29eb7-c397-49ba-8afb-12d87fdb332c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:41.813986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:41.815731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.816899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.817188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.847857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:41.847857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a0aaf-e295-426d-85d3-ed9235d9cb59 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:41.866417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 797/1615] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:41.867556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.869864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 819/1616] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:41.871479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:41.871776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.872078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.876427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:41.880455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:41.890232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:41.916958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.919282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:41.943062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] MFA Rules not processed for user `7c34e756151b4d95a0b013200a0ccb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:41.953785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:42.082821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 820/1617] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:42.084332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.126368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 798/1618] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:42.127528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.148173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7e050-6fa9-437f-b94e-56917c82f2e0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.157895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.158261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.158503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.159367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.211840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d8cab-35c1-43fc-b7a1-5050809b5a63 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.220313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.221199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.222056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.222363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.233665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.236939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.241707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.245046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.248426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 799/1619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:42.250527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.261963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b4e72-c7e2-4c42-a773-ba6c6687f619 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.269574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.269969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.270301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.270583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.271283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.273346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.287428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 821/1620] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:42.305807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 800/1621] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:42 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:42.310239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.335334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd326c-ea7e-496f-95da-94ad4e21114a service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.454363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.455638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.455638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.455638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.456301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.458226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.498349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.499115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 822/1622] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:42 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:42.515057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af4692-dfc8-44b5-a164-f61570f7130a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.522828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.523279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.523954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.524325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.525227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.527283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.544263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.555928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 801/1623] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:42.557428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2ee5b-ec55-4eef-928c-5397f553a998 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.563421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.564616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.565012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.565396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] PATH_INFO: `/v3/projects/f823c7219b224881932431f705a5c0d1/users/737bf5ec11924877b379e568da2e16c6/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.582434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f823c7219b224881932431f705a5c0d1, user_id=737bf5ec11924877b379e568da2e16c6, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.585605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.617934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 823/1624] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:42 2022] PUT /identity/v3/projects/f823c7219b224881932431f705a5c0d1/users/737bf5ec11924877b379e568da2e16c6/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:09:42.619069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.635618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e235-0ffb-4f33-8259-2ccf5f692cd7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.666027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:42.779616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.789474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.789474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.789474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.789474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.789474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96049e4-b56d-4c90-b262-4d299fded286 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.800970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 802/1625] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:42.804069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:42.815394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:42.826152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98e9b-f626-4081-8f45-c92c5c160ae5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:42.840773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:42.844586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.844586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.844857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] PATH_INFO: `/v3/projects/f823c7219b224881932431f705a5c0d1/users/737bf5ec11924877b379e568da2e16c6/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.849146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f823c7219b224881932431f705a5c0d1, user_id=737bf5ec11924877b379e568da2e16c6, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:42.852600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:42.892582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 824/1626] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:42 2022] PUT /identity/v3/projects/f823c7219b224881932431f705a5c0d1/users/737bf5ec11924877b379e568da2e16c6/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:42.904285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f227-a818-4457-ab0a-1366132aa530 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:42.904285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f227-a818-4457-ab0a-1366132aa530 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:42.904285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554f227-a818-4457-ab0a-1366132aa530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:42.976023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5554f227-a818-4457-ab0a-1366132aa530 None None] MFA Rules not processed for user `737bf5ec11924877b379e568da2e16c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:42.977944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5554f227-a818-4457-ab0a-1366132aa530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:43.106469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 803/1627] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:43.119919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:43.325668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa151ec-97d6-41ad-bf1a-e8b410f97563 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:43.337789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:43.339314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.339693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.340061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.382582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:43.383695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:43.496316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 825/1628] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:43.623616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea5d0-5627-43bb-b1f7-03444d99f62a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.624252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea5d0-5627-43bb-b1f7-03444d99f62a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.624252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea5d0-5627-43bb-b1f7-03444d99f62a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.626345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 804/1629] 10.222.0.47 () {54 vars in 961 bytes} [Wed Jun 29 16:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:09:43.628022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:43.647174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27f0f-2a88-487e-b737-531a07ff0835 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.650178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27f0f-2a88-487e-b737-531a07ff0835 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.650715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27f0f-2a88-487e-b737-531a07ff0835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.659951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1deb92-4ec8-4169-83d1-96166cd39cf2 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:43.665609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:43.666580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.667092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.667599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.711394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-adf27f0f-2a88-487e-b737-531a07ff0835 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:43.714937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-adf27f0f-2a88-487e-b737-531a07ff0835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:43.799117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:43.800776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4361-b916-4f32-87ec-83ddf69cfc55 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:43.812093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 826/1630] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:43.835205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 805/1631] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Jun 29 16:09:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:43.836785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314cc-f2c6-49de-984a-89a07ac4c09d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.836897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314cc-f2c6-49de-984a-89a07ac4c09d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.837272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314cc-f2c6-49de-984a-89a07ac4c09d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.838733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 827/1632] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jun 29 16:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:09:43.852394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72652-d3d5-4129-9abe-4ed7735a45c8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.855386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72652-d3d5-4129-9abe-4ed7735a45c8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.856058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72652-d3d5-4129-9abe-4ed7735a45c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.882612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e2a72652-d3d5-4129-9abe-4ed7735a45c8 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:43.884913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e2a72652-d3d5-4129-9abe-4ed7735a45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:43.907770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 806/1633] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:09:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:43.915110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5314cc-f2c6-49de-984a-89a07ac4c09d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:43.931496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5314cc-f2c6-49de-984a-89a07ac4c09d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:43.940733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:43.941530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:43.941819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:43.942096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:43.969984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:43.971450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611161c5-3c68-4e16-b7a0-71f45a2e22c9 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:44.001608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 828/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:44.203929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b5a5-a43f-46ef-b2fc-c419fbdea861 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:44.204223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b5a5-a43f-46ef-b2fc-c419fbdea861 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:44.204498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b5a5-a43f-46ef-b2fc-c419fbdea861 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:44.206205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 807/1635] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jun 29 16:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:09:44.216511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:44.217103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:44.217103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:44.248187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:44.249293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:44.267391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 829/1636] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:44.302696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b5a5-a43f-46ef-b2fc-c419fbdea861 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:44.322129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b5a5-a43f-46ef-b2fc-c419fbdea861 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:44.331090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:44.332475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:44.332763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:44.333043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:44.385149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:44.386800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce72132-bd8e-4653-a191-09bcb6f31bfa service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:44.421191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 808/1637] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:44.536514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:44.661431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825568de-b867-40e0-9bc8-10032c1c2bd5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:44.667553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:44.668971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:44.669361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:44.669742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] PATH_INFO: `/v3/users/2e88276aba204eeb8af05590f7904d5d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:44.671277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88276aba204eeb8af05590f7904d5d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:44.672639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: WARNING py.warnings [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:44.672639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: warnings.warn(msg) Jun 29 16:09:44.672639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: Jun 29 16:09:44.674405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:44.697905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:44.815230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88276aba204eeb8af05590f7904d5d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:44.838189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88276aba204eeb8af05590f7904d5d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:44.840286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88276aba204eeb8af05590f7904d5d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:44.842736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88276aba204eeb8af05590f7904d5d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:44.894895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88276aba204eeb8af05590f7904d5d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:44.940635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 830/1638] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:44 2022] DELETE /identity/v3/users/2e88276aba204eeb8af05590f7904d5d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:44.948962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:44.949525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:44.951281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:44.997577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:44.998832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:45.003164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:45.113805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 809/1639] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:45.142938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:45.144391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:45.272117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c080773-0c31-41cd-bb0d-cded32cb7f9f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:45.284433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:45.285628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:45.286209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:45.287796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:45.305908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:45.311463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b928ea-7981-425f-b0ee-6abdc5df1cae service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:45.326674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 831/1640] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:46.369142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:46.370907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:46.393534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54cd5-7932-4364-95fe-5d0405926a75 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:46.419323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:46.420801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:46.421333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:46.422068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] PATH_INFO: `/v3/projects/2c817ebe7ac040be9c2f0a63d8a86dfa` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:46.424578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c817ebe7ac040be9c2f0a63d8a86dfa)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:46.425899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: WARNING py.warnings [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 16:09:46.425899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: warnings.warn(msg) Jun 29 16:09:46.425899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: Jun 29 16:09:46.427589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:46.577282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c817ebe7ac040be9c2f0a63d8a86dfa', 'request_id': 'req-ff830c89-e431-4ba5-be81-fadd9a791e0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:46.594454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c817ebe7ac040be9c2f0a63d8a86dfa', 'request_id': 'req-ff830c89-e431-4ba5-be81-fadd9a791e0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:46.641850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c817ebe7ac040be9c2f0a63d8a86dfa', 'request_id': 'req-ff830c89-e431-4ba5-be81-fadd9a791e0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:46.663720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] The token cache is being invalidate because project 2c817ebe7ac040be9c2f0a63d8a86dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:09:46.664212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:46.665731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ff830c89-e431-4ba5-be81-fadd9a791e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:46.667760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 810/1641] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:09:46 2022] DELETE /identity/v3/projects/2c817ebe7ac040be9c2f0a63d8a86dfa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:09:46.672945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:46.673448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:46.673588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:46.715176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:46.716793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:46.824634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 832/1642] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:46.832582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:46.832875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:46.833547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:46.857961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:46.859868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:46.883768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:46.893611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 811/1643] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:46.899055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab636858-db0f-49cb-bfc9-e00928f67ded None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:46.906645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:46.907536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:46.909297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:46.909886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:46.910961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:46.911437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:46.915533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:46.944717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:46.957017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 833/1644] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:09:46.958965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4759c7-6c69-492c-ab8f-e2a21eaf6c84 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:46.964715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:46.965570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:46.965991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:46.966422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:46.967448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:46.970210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:47.012240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 812/1645] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:46 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:47.019457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:47.035155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe91c6-0870-4014-9c1a-d9620d1a2cb7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:47.079789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:47.174836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:47.175666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:47.176086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:47.176511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:47.177315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:47.179466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:47.211617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 834/1646] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:47 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:47.215486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:47.226124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c8c74-97d0-4191-b4e1-49137d4dcbff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:47.233652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:47.235224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:47.236466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:47.236864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:47.237892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:47.240673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:47.267931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 813/1647] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:47.273526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:47.300433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1f4bc-da1c-43cc-bbdd-e1cf4b88c607 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:47.307031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:47.308184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:47.308722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:47.310640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:47.312788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:47.316298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37af7be-7638-4629-8c3d-a45a32eb005a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:47.337953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 835/1648] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:09:47.342382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:47.361712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518fceb-f504-4cd8-9d6f-fb9795138796 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:47.374569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:47.376225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:47.376622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:47.377146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] PATH_INFO: `/v3/projects/b5cde10a909349cc8a7d5a7c82923334/users/e3beceb864a742afbb1f62ce3d55d774/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:47.415484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cde10a909349cc8a7d5a7c82923334, user_id=e3beceb864a742afbb1f62ce3d55d774, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:47.418715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:47.464718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 814/1649] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:47 2022] PUT /identity/v3/projects/b5cde10a909349cc8a7d5a7c82923334/users/e3beceb864a742afbb1f62ce3d55d774/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:47.477147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:47.477593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:47.477938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:47.537794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] MFA Rules not processed for user `e3beceb864a742afbb1f62ce3d55d774`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:47.539213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:47.750833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 836/1650] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:47.754371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:47.843436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:47.982900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31cdd-178b-4c6c-a33d-4f52520fb4b7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.001136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.002195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.002706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.003352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.004308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.009072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.080933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:48.084079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 815/1651] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:47 2022] POST /identity/v3/projects => generated 405 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:48.106334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85038-8858-4d4f-998a-ae3c5736ea92 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.271094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.271939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.272335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.272752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.276765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.278984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.332335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:48.340601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 837/1652] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:48 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:48.362969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671501-774b-4c40-9677-e6d0fcf216b3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.376127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.377071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.377354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.377632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.378366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.380020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.422936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 816/1653] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:48.427339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:48.459691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1115dd-5504-483c-80be-b1603a444a73 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.480377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.482250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.482655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.484807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] PATH_INFO: `/v3/projects/59d343a1d27d4925a2ac9712f193c815/users/a23739c4b11e45feaf17bf3549b98ce0/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.524865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d343a1d27d4925a2ac9712f193c815, user_id=a23739c4b11e45feaf17bf3549b98ce0, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.529595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.538293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:48.569558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 838/1654] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:48 2022] PUT /identity/v3/projects/59d343a1d27d4925a2ac9712f193c815/users/a23739c4b11e45feaf17bf3549b98ce0/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:48.571053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:48.586796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0a42-09a1-4031-abfe-fa2bba0da68b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.777594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.778423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.778924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.779308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.780409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.783195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995771a-0bab-48e2-8ed2-40757efe919b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.803485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 817/1655] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:48.807126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:48.820056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2ea56-9d75-4224-981b-356b1f2fdd98 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:48.835705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:48.838770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.839278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.839817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] PATH_INFO: `/v3/projects/59d343a1d27d4925a2ac9712f193c815/users/a23739c4b11e45feaf17bf3549b98ce0/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.846780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d343a1d27d4925a2ac9712f193c815, user_id=a23739c4b11e45feaf17bf3549b98ce0, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:48.850804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:48.879414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 839/1656] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:48 2022] PUT /identity/v3/projects/59d343a1d27d4925a2ac9712f193c815/users/a23739c4b11e45feaf17bf3549b98ce0/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:48.893243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:48.893617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:48.893899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:48.939070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] MFA Rules not processed for user `a23739c4b11e45feaf17bf3549b98ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:48.940836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:49.028666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:49.033010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:49.114351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 818/1657] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:49.116761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:49.119622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:49.184235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c363d-cca4-42d4-af8a-e74fbd2a512b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:49.186891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:49.194008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:49.195461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:49.195940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:49.197741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] PATH_INFO: `/v3/users/7c34e756151b4d95a0b013200a0ccb71` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:49.199583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c34e756151b4d95a0b013200a0ccb71)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:49.202330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:49.269860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22a088-5b16-4958-a725-fda28daa5c74 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:49.280329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:49.281742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:49.282134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:49.282669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:49.304720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:49.306714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a7da0-8b4a-4ee8-83ba-e8d76aa03960 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:49.330365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 819/1658] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:49 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:49.345409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c34e756151b4d95a0b013200a0ccb71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:49.373247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c34e756151b4d95a0b013200a0ccb71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:49.375196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c34e756151b4d95a0b013200a0ccb71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:49.376049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c34e756151b4d95a0b013200a0ccb71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:49.398381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c34e756151b4d95a0b013200a0ccb71'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:49.438392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 840/1659] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:49 2022] DELETE /identity/v3/users/7c34e756151b4d95a0b013200a0ccb71 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:49.443643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7704db-288f-4b77-a203-a5a9b618d892 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:49.444608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7704db-288f-4b77-a203-a5a9b618d892 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:49.445095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7704db-288f-4b77-a203-a5a9b618d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:49.500476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6a7704db-288f-4b77-a203-a5a9b618d892 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:49.503070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6a7704db-288f-4b77-a203-a5a9b618d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:49.631376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:49.634329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:49.676919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 820/1660] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:49.844130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bdb64-e8c8-46bd-8b1f-bdd5dcb79c7f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:49.869272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:49.870853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:49.872783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:49.875360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] PATH_INFO: `/v3/users/e3beceb864a742afbb1f62ce3d55d774` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:49.883471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3beceb864a742afbb1f62ce3d55d774)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:49.891900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:49.899719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:50.052348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3beceb864a742afbb1f62ce3d55d774'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:50.074170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3beceb864a742afbb1f62ce3d55d774'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:50.074961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3beceb864a742afbb1f62ce3d55d774'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:50.075730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3beceb864a742afbb1f62ce3d55d774'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:50.095521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3beceb864a742afbb1f62ce3d55d774'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:50.172992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 841/1661] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:49 2022] DELETE /identity/v3/users/e3beceb864a742afbb1f62ce3d55d774 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:50.175995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:50.176401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:50.176616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:50.222302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:50.223550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:50.352876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:50.359216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:50.378864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 821/1662] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:50.393386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:50.395646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:50.512466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1ea78-cca8-4dfd-8656-9a63d0f496e6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:50.524090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:50.524765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:50.525177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:50.525386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:50.532664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:50.570460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:50.576237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:50.582499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06761d0-35af-4479-9894-7e9579614dfe None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:50.595450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:50.596383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:50.596773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:50.597656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:50.601304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 842/1663] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:09:50.619669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:50.622879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:50.641350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 822/1664] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:09:52.071111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:52.073600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:52.100605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9352f5-8cbe-466b-9404-f1f5ed9110b2 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:52.114351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:52.115251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:52.115534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:52.115808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] PATH_INFO: `/v3/projects/746d8195d5634783bbd1d0a4400aaf89` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:52.117231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746d8195d5634783bbd1d0a4400aaf89)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:52.119157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:52.159217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:52.161454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:52.192676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c138a33-2e1d-4950-8b69-d3aed8f35c30 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:52.210742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:52.219095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:52.219392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:52.221088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] PATH_INFO: `/v3/projects/b5cde10a909349cc8a7d5a7c82923334` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:52.225749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cde10a909349cc8a7d5a7c82923334)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:52.232608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:52.240889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746d8195d5634783bbd1d0a4400aaf89', 'request_id': 'req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.251884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:52.258890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746d8195d5634783bbd1d0a4400aaf89', 'request_id': 'req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.276674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746d8195d5634783bbd1d0a4400aaf89', 'request_id': 'req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.293578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] The token cache is being invalidate because project 746d8195d5634783bbd1d0a4400aaf89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:09:52.293845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.297268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.311114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 843/1665] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:09:52 2022] DELETE /identity/v3/projects/746d8195d5634783bbd1d0a4400aaf89 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:52.312888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:52.314424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:52.329482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:52.405161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cde10a909349cc8a7d5a7c82923334', 'request_id': 'req-f7452163-d5a7-4394-9ef8-b726df27ab92'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.430373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cde10a909349cc8a7d5a7c82923334', 'request_id': 'req-f7452163-d5a7-4394-9ef8-b726df27ab92'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.442241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cde10a909349cc8a7d5a7c82923334', 'request_id': 'req-f7452163-d5a7-4394-9ef8-b726df27ab92'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.479013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] The token cache is being invalidate because project b5cde10a909349cc8a7d5a7c82923334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:09:52.479013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.479951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.485467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 823/1666] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:09:52 2022] DELETE /identity/v3/projects/b5cde10a909349cc8a7d5a7c82923334 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:52.489267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:52.491198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:52.515159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333063d-5b79-4b8f-9a1c-1c68f104f1d3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:52.657313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452163-d5a7-4394-9ef8-b726df27ab92 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:52.665001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:52.666354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:52.666772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:52.667326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] PATH_INFO: `/v3/users/a23739c4b11e45feaf17bf3549b98ce0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:52.668985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23739c4b11e45feaf17bf3549b98ce0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:52.672325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:52.672566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:52.673535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:52.673812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:52.674090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] PATH_INFO: `/v3/users/737bf5ec11924877b379e568da2e16c6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:52.676204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737bf5ec11924877b379e568da2e16c6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:52.678268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:52.769509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737bf5ec11924877b379e568da2e16c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.780790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23739c4b11e45feaf17bf3549b98ce0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.787581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737bf5ec11924877b379e568da2e16c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.788573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737bf5ec11924877b379e568da2e16c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.789657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737bf5ec11924877b379e568da2e16c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.802464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23739c4b11e45feaf17bf3549b98ce0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.803301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23739c4b11e45feaf17bf3549b98ce0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.811921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737bf5ec11924877b379e568da2e16c6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.822113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23739c4b11e45feaf17bf3549b98ce0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.853431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fe2c3032-b76b-41a2-aeca-267992219cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23739c4b11e45feaf17bf3549b98ce0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:52.864598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 844/1667] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:52 2022] DELETE /identity/v3/users/737bf5ec11924877b379e568da2e16c6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:52.873421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 824/1668] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:52 2022] DELETE /identity/v3/users/a23739c4b11e45feaf17bf3549b98ce0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:09:54.693508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:54.695579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:54.801297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:54.911456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabeab8-0308-42d2-8dec-8adbba91db25 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:55.024731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:55.025644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.025917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.026193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] PATH_INFO: `/v3/projects/59d343a1d27d4925a2ac9712f193c815` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.028582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d343a1d27d4925a2ac9712f193c815)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:55.032059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:55.120983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d343a1d27d4925a2ac9712f193c815', 'request_id': 'req-835b8c6e-df5e-47fd-afae-d479d2add92a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:55.146224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d343a1d27d4925a2ac9712f193c815', 'request_id': 'req-835b8c6e-df5e-47fd-afae-d479d2add92a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:55.163968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d343a1d27d4925a2ac9712f193c815', 'request_id': 'req-835b8c6e-df5e-47fd-afae-d479d2add92a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:55.189588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] The token cache is being invalidate because project 59d343a1d27d4925a2ac9712f193c815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:09:55.190125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:55.191512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-835b8c6e-df5e-47fd-afae-d479d2add92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:55.193944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 845/1669] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:09:54 2022] DELETE /identity/v3/projects/59d343a1d27d4925a2ac9712f193c815 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:55.200848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014e83e-9f50-45d1-aea7-2e55e8ac4c25 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.201392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014e83e-9f50-45d1-aea7-2e55e8ac4c25 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.201392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014e83e-9f50-45d1-aea7-2e55e8ac4c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.242105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.242487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.242982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.251782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2014e83e-9f50-45d1-aea7-2e55e8ac4c25 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:55.253176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2014e83e-9f50-45d1-aea7-2e55e8ac4c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:55.268118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:55.302590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] MFA Rules not processed for user `d75d976f2c554209bc4c64d338ad7cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:55.305092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:55.387154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 825/1670] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:55.397433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.399612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.399930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.415487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:55.426455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 846/1671] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:55.439307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:55.442270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:55.446742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:55.449766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:55.454981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 826/1672] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:55.458968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:55.475643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bf068-7a71-4c4a-9ded-409f3db57ffa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:55.481912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:55.482801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.483085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.483364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.484701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:55.485010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:55.486869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:55.512480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 827/1673] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:09:55.513154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:55.554931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256675e-0efa-474a-87fd-df45a52dc03f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:55.564844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:55.565912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.566408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.566921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.567982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:55.586819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba60314-ade4-4aad-915d-f0e0f9ff3a48 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:55.655055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 828/1674] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:55.658612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:55.659412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:55.660011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:55.743616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] MFA Rules not processed for user `ba6701e26058440fa098a6a0e9da7f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:55.745194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:55.905269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 829/1675] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:55.906416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:55.931871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088713-2ddc-4e24-802f-e2cb11cf585d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.042015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.043081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.043882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c91c0-bd67-4be5-b020-04a1d1438f66 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.045092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.045522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.053952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.054674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.054957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.055237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.056013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.058664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.081318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:56.111317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 830/1676] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:55 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:56.115876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:56.118514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.133209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.136241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce1d2-ebf6-4e30-aea8-699f0e6d40ba service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.138148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ef42e-00f4-46a8-bfb1-bdc56159b3dc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.144157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.145423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.145423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.145704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] PATH_INFO: `/v3/users/680a55dbab784e2d85b74a972d3bdac9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.147119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] RBAC: Authorizing `identity:delete_user(user_id=680a55dbab784e2d85b74a972d3bdac9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.149181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.156833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 847/1677] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:09:56.161239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.162212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.162501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.203436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] MFA Rules not processed for user `ba6701e26058440fa098a6a0e9da7f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:56.205136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.227229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 848/1678] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:56.228462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:56.255542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995365c3-b554-4885-9b85-5b20bfd221fa None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.269122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.269721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.269997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.270271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.271003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.272793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.298915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680a55dbab784e2d85b74a972d3bdac9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.309882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680a55dbab784e2d85b74a972d3bdac9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.310696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680a55dbab784e2d85b74a972d3bdac9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.320203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 849/1679] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:56.321274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:56.324007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680a55dbab784e2d85b74a972d3bdac9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.325539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.344184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283914-ea98-418f-8195-77cdffce87bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.349948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.350984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.351379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.351802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] PATH_INFO: `/v3/projects/f823c7219b224881932431f705a5c0d1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.353766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f823c7219b224881932431f705a5c0d1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.356154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.382440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:56.391702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680a55dbab784e2d85b74a972d3bdac9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.428553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 831/1680] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:09:56 2022] DELETE /identity/v3/users/680a55dbab784e2d85b74a972d3bdac9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:56.430226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:56.442987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.455210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f823c7219b224881932431f705a5c0d1', 'request_id': 'req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.498450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f823c7219b224881932431f705a5c0d1', 'request_id': 'req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.522202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f823c7219b224881932431f705a5c0d1', 'request_id': 'req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.555973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] The token cache is being invalidate because project f823c7219b224881932431f705a5c0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:09:56.556333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.557587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:09:56.565411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 850/1681] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:09:56 2022] DELETE /identity/v3/projects/f823c7219b224881932431f705a5c0d1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:56.565411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:56.568953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.679813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca680db-ad0f-4bf9-a169-362e017c384c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.727939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.728920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.729202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfd7d-d430-4b68-9da1-cd693ad81e1c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:56.729838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.730949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.733406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.881732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:56.882432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.882722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.882990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.883734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.886214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad1b8-bf5c-4910-9279-43a07339efdf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.918290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 851/1682] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:56.927460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:56.928339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.928633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.928992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.935447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3200-0e20-4663-bdcd-251afc6a1a10 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:56.951948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:56.968038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 832/1683] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:56.969217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:56.970390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62836-db2d-4a7f-8210-485e27164f38 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:56.970673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.971063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62836-db2d-4a7f-8210-485e27164f38 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:56.971452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62836-db2d-4a7f-8210-485e27164f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:56.993275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8dc62836-db2d-4a7f-8210-485e27164f38 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:56.994731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8dc62836-db2d-4a7f-8210-485e27164f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:56.996745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 852/1684] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:56.997984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.014322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f85b3-f84a-44ac-b3bd-faed2f9af983 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.014493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 833/1685] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:57.023614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.023940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.024219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.030234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.032265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.032752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.033237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] PATH_INFO: `/v3/projects/fbb5ee6ce3364965881762c4ef989135/users/3f5cdb7a99694868bb53631514b4ce1d/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.055661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:57.056948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:57.066618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 834/1686] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:09:57.067717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.068354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb5ee6ce3364965881762c4ef989135, user_id=3f5cdb7a99694868bb53631514b4ce1d, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.072213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:57.073036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.105068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 853/1687] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:56 2022] PUT /identity/v3/projects/fbb5ee6ce3364965881762c4ef989135/users/3f5cdb7a99694868bb53631514b4ce1d/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:57.106684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.151801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:57.299726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b8b6f-7fd4-43a8-a814-9411683a3c42 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.308343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86af8-4730-416a-9c52-eed365d1cf62 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.322767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.323465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.323751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.324449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.325196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:09:57.325509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.330687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42067-42f5-4866-9775-cd7460a0a63f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.362433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 854/1688] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:09:57.363802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.364185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.364471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.406548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.407712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.408101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.408515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.423621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] MFA Rules not processed for user `3f5cdb7a99694868bb53631514b4ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:57.425020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:57.434573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.438332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.475361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 835/1689] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:57.479108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.501615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431632-507d-43fd-8f32-5d20e5d9480e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.515088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.519166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.520781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.521108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.521823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.524213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.625401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 836/1690] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:57.629813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.667919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 855/1691] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:57.672987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.696756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8b0b4-2d40-4d54-bfdb-25858130f79a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.798454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab031cca-bcf7-4c27-9e40-cb2fb99438fe admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.817388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.818631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.820265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.821881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.822847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.832414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.858018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.861075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.861593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.862111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.863107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.866317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.887321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 837/1692] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:57.888824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.902819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd381f-3ff5-4fbe-a4ce-eb207d543414 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.913178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:57.914290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:57.914901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:57.915456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:57.916652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:57.919477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:57.956119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 838/1693] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:57.957484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:57.966372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:57.976174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 856/1694] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:57.977620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e3a7-39bf-442a-a509-2f8d6ebc6e8a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:57.980210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.050381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:58.156349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.160032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.160462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.160743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.164470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.169447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.190034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b584f-0454-4b0f-a268-9423b0fd34be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.198565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 839/1695] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:58.200050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.204815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.205527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.207474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.207774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.210235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.216206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.226147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691e53-1152-4278-b425-de18389d3ed9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.240604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.246273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.249088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.249416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] PATH_INFO: `/v3/projects/fc7cce9e43cb48efb8776e47991afd64/users/b12d2c9f5e5546009eceb484a52487f8/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.284959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 857/1696] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:57 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:58.285408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.301710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7cce9e43cb48efb8776e47991afd64, user_id=b12d2c9f5e5546009eceb484a52487f8, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.312339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726557c3-45f4-43d9-a43e-a48f08410ae8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.315002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04147b35-9e93-4b41-98c6-e9e90540361e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.329992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.330740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.331023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.331302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.332161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.336308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.347186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 840/1697] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:58 2022] PUT /identity/v3/projects/fc7cce9e43cb48efb8776e47991afd64/users/b12d2c9f5e5546009eceb484a52487f8/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:58.362111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.362990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.362990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.375846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 858/1698] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:58.376843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.408575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6bf6-1331-4bdf-a178-3719034dd201 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.442662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] MFA Rules not processed for user `b12d2c9f5e5546009eceb484a52487f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:58.446459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:58.616560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.619269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.625233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.625572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] PATH_INFO: `/v3/projects/b29f676a4c0841239c18108208de50e0/users/93ea974f80be473c9a9413e363e45308/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.661643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 841/1699] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:58.663542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.668885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29f676a4c0841239c18108208de50e0, user_id=93ea974f80be473c9a9413e363e45308, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.672204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.692165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4d858-7e74-4cf0-844f-70d78b6055d1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.705793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.709195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.709509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.709794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.711666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.719037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.723384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 859/1700] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:58 2022] PUT /identity/v3/projects/b29f676a4c0841239c18108208de50e0/users/93ea974f80be473c9a9413e363e45308/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:58.724549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.780054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 842/1701] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:58.786249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.831574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05be98-fe14-49c6-a450-9497e1821f33 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.890214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:58.909504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:58.939093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.939777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.940094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.940372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.941115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.942792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.956229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dd379-0929-4e34-bad1-78708c8078e3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.962197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 860/1702] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:58.963411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:58.971191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.972727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.974144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.974444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:58.978849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:58.980210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a6e4e-550e-495c-9a42-c84c50122285 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:58.987278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53571614-e391-4ed3-84f2-05ea11166aba admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:58.994542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:58.996070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:58.996594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:58.996997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] PATH_INFO: `/v3/projects/b29f676a4c0841239c18108208de50e0/users/93ea974f80be473c9a9413e363e45308/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.000916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29f676a4c0841239c18108208de50e0, user_id=93ea974f80be473c9a9413e363e45308, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.003913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.019506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 861/1703] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:58 2022] PUT /identity/v3/projects/b29f676a4c0841239c18108208de50e0/users/93ea974f80be473c9a9413e363e45308/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:59.020344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 843/1704] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:09:58 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:09:59.028977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:59.029883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.030529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.031524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.067400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] MFA Rules not processed for user `93ea974f80be473c9a9413e363e45308`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:59.069170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:59.163793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a7cee-3c75-4ab7-a8ae-224523a03614 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:59.180780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:59.181599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.181973 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.182343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.183183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.184933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.198917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 844/1705] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:59.210279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 862/1706] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:09:59.212514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:59.220942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:59.225203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:59.249264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb777f45-3cf2-4e58-8302-36d7de81fec0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:59.267065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:59.267256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.267466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.267745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] PATH_INFO: `/v3/projects/c471ed8f164f46f392da0780b1a7b3ad/users/3bce8f3270464e88b6c2070c6d71df33/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.307565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c471ed8f164f46f392da0780b1a7b3ad, user_id=3bce8f3270464e88b6c2070c6d71df33, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.314007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.343016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 845/1707] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:59 2022] PUT /identity/v3/projects/c471ed8f164f46f392da0780b1a7b3ad/users/3bce8f3270464e88b6c2070c6d71df33/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:59.344548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:59.388552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375ad7-ddf2-4a4d-b0ea-a81ae1ae5b0a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:59.505806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674dbb-32e5-4141-ba07-d6952c4a0083 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:59.517545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:59.518233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.518507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.518789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.523075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:59.524420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.524705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.524979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.525722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.527368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778cbfd-88aa-436e-a470-6b4d84f07fa5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.575379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 846/1708] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:09:59.576913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807506b1-d353-4240-841a-f2ea478e2ff5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.577210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807506b1-d353-4240-841a-f2ea478e2ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.577492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807506b1-d353-4240-841a-f2ea478e2ff5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.584058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:59.584959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 847/1709] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jun 29 16:09:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:09:59.585827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807506b1-d353-4240-841a-f2ea478e2ff5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:09:59.616504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807506b1-d353-4240-841a-f2ea478e2ff5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:09:59.634540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:09:59.635498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.635785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.636085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] PATH_INFO: `/v3/projects/c471ed8f164f46f392da0780b1a7b3ad/users/3bce8f3270464e88b6c2070c6d71df33/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.642507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c471ed8f164f46f392da0780b1a7b3ad, user_id=3bce8f3270464e88b6c2070c6d71df33, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.646040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d43bc2-93f5-4648-ae5e-f34fa7e72349 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.682711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 848/1710] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:09:59 2022] PUT /identity/v3/projects/c471ed8f164f46f392da0780b1a7b3ad/users/3bce8f3270464e88b6c2070c6d71df33/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:09:59.694160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe256d-6741-410b-b224-44d13fd21061 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.694476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe256d-6741-410b-b224-44d13fd21061 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.694734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe256d-6741-410b-b224-44d13fd21061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.720862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:09:59.736430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391cc5-81f6-4b00-8aac-bdbce6c409bd service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:09:59.757789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 863/1711] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:09:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:09:59.759137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e45f-8611-4449-99bb-1a4d67dbd293 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.759427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e45f-8611-4449-99bb-1a4d67dbd293 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.762670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3ffe256d-6741-410b-b224-44d13fd21061 None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:59.764089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3ffe256d-6741-410b-b224-44d13fd21061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:59.765246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e45f-8611-4449-99bb-1a4d67dbd293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.794780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:09:59.837526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-21e4e45f-8611-4449-99bb-1a4d67dbd293 None None] MFA Rules not processed for user `1c00db02926f4d849249c3990fdf8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:59.839044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21e4e45f-8611-4449-99bb-1a4d67dbd293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:59.910611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 849/1712] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:59.916682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.917008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.918793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.956994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 864/1713] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:09:59.967231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:09:59.967510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:09:59.967786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:09:59.986354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] MFA Rules not processed for user `1c00db02926f4d849249c3990fdf8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:09:59.987519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:09:59.999596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 865/1714] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:00.007676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.011163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:00.018276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] MFA Rules not processed for user `3bce8f3270464e88b6c2070c6d71df33`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:00.020403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:00.204183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6aa6-b6b2-4fa7-82e1-6ec3070935a1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:00.206583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 850/1715] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:00.207315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.209240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:00.228099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:00.228777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.229060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.229338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.242438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:00.243419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4969e-5300-4e97-8005-404c627a3fba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:00.245267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:00.250547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:00.251557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.251983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.253301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.270221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:00.271974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:00.272861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 866/1716] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:00.273746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.291805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 851/1717] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:00.335746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:00.362626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.364534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:00.412362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b185da-b9df-45d2-90f9-856f490f4a89 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:00.423956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:00.425048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.425385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.425670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.447477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:00.449206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:00.485230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 867/1718] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:00.556704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279b20-30e6-477e-9b89-9b0608f32389 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:00.566925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:00.567553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.567962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.568873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] PATH_INFO: `/v3/projects/8e5ae05750a0464b80b73aefe24d0e9a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.576033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5ae05750a0464b80b73aefe24d0e9a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:00.576033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:00.579310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.606535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd7511-ab98-4e06-bf0b-7cf4dfd1a85b service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:00.619764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:00.621121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.624155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.624611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] PATH_INFO: `/v3/users/b12d2c9f5e5546009eceb484a52487f8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.628541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12d2c9f5e5546009eceb484a52487f8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:00.633789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:00.686593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:00.709400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5ae05750a0464b80b73aefe24d0e9a', 'request_id': 'req-3ed53587-3c4a-462e-964d-6e4f6abcf262'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.729784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5ae05750a0464b80b73aefe24d0e9a', 'request_id': 'req-3ed53587-3c4a-462e-964d-6e4f6abcf262'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.749260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5ae05750a0464b80b73aefe24d0e9a', 'request_id': 'req-3ed53587-3c4a-462e-964d-6e4f6abcf262'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.791446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] The token cache is being invalidate because project 8e5ae05750a0464b80b73aefe24d0e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:00.792221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12d2c9f5e5546009eceb484a52487f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.794490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.798371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3ed53587-3c4a-462e-964d-6e4f6abcf262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.801642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 852/1719] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:00 2022] DELETE /identity/v3/projects/8e5ae05750a0464b80b73aefe24d0e9a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:00.806883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9374e-22c8-438a-818b-3e01b83ad024 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:00.807447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9374e-22c8-438a-818b-3e01b83ad024 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:00.807865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9374e-22c8-438a-818b-3e01b83ad024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:00.811244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12d2c9f5e5546009eceb484a52487f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.813217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12d2c9f5e5546009eceb484a52487f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.813217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12d2c9f5e5546009eceb484a52487f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.849518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12d2c9f5e5546009eceb484a52487f8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:00.886044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15c9374e-22c8-438a-818b-3e01b83ad024 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:00.896252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15c9374e-22c8-438a-818b-3e01b83ad024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:00.917397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 868/1720] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:00 2022] DELETE /identity/v3/users/b12d2c9f5e5546009eceb484a52487f8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:00.923030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:00.926815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:01.088653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 853/1721] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:01.090208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740a64-168e-4385-b70c-692162cf9760 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.090615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740a64-168e-4385-b70c-692162cf9760 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.091005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740a64-168e-4385-b70c-692162cf9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.108590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9e98-6767-4929-859c-faedd0e0da62 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:01.135995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:01.139755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.140743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.142586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] PATH_INFO: `/v3/users/3f5cdb7a99694868bb53631514b4ce1d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.144799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5cdb7a99694868bb53631514b4ce1d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:01.145998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0d740a64-168e-4385-b70c-692162cf9760 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:01.149131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0d740a64-168e-4385-b70c-692162cf9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:01.150680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:01.173561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 854/1722] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:01.175419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.175847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.176257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.221925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:01.228418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:01.264887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:01.272040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 855/1723] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:01.275130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:01.294591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5cdb7a99694868bb53631514b4ce1d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:01.309228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69c544-b682-454b-8a04-2f3f8255b3df None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:01.316547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5cdb7a99694868bb53631514b4ce1d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:01.317447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5cdb7a99694868bb53631514b4ce1d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:01.324963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5cdb7a99694868bb53631514b4ce1d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:01.333156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:01.342367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.342883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.343167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.346141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:01.346453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:01.352858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ecbd9513-f58d-4230-baea-e95f06c735ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5cdb7a99694868bb53631514b4ce1d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:01.357125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:01.430889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 856/1724] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:01.447154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:01.461699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:01.477481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 869/1725] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:00 2022] DELETE /identity/v3/users/3f5cdb7a99694868bb53631514b4ce1d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:01.485579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.485881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.486153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.525840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408bfd-0549-400d-bead-1a5b8c1d2092 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:01.565540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:01.567015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:01.735062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:01.736114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:01.736565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:01.736985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:01.737844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:01.753992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:01.803025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 870/1726] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:01.821283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 857/1727] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:01 2022] POST /identity/v3/projects => generated 405 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:01.825285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:01.850100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a116-df52-4a99-b58d-d099b32f57bc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:01.918150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:01.928569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.048494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:02.072890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.088652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.088985 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.089269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.090113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.105922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.143277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d52d-4cd4-4901-b60b-ccc7f1926768 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.152735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.154039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.154462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.156112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.178949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 871/1728] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:01 2022] POST /identity/v3/users => generated 303 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:02.179561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.182577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.188349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354551-d49a-48a7-801c-7009ca2010ad service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.188515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.213960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 858/1729] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:02.217858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875921fa-7752-4f79-b1ee-c965d5543720 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.218150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875921fa-7752-4f79-b1ee-c965d5543720 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.219762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875921fa-7752-4f79-b1ee-c965d5543720 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.223894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 859/1730] 10.222.0.47 () {54 vars in 912 bytes} [Wed Jun 29 16:10:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:02.226095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875921fa-7752-4f79-b1ee-c965d5543720 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.230422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547f4fc-0a79-47b6-a47b-683fc3b6ef01 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.251763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.252471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.252734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.253011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.257268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.263752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875921fa-7752-4f79-b1ee-c965d5543720 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.275792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.276303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.276634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.276917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.277797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.279431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485109-07dc-44ad-b4e0-89fcabcf2f9d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.302317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 860/1731] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:02.303054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.303693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.307377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.308209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.308541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.335886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 872/1732] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:02.341553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.347908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:02.354326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.370931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa2afd-5d34-46ea-bc35-b0713cdc22e8 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.373244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 861/1733] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:02.380819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.381937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.382343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.382755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.383616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.385851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909573d2-bb9e-4b5f-a95c-bc0a0fe84cbc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.426050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 873/1734] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:02.431133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.452934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffbaf0-bdb2-4c67-a6bb-6ef71d114aab None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.464181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.465920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.467232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.469931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] PATH_INFO: `/v3/projects/10e4de90a5c942aa86cd9067510b751e/users/284a12c61cab45c59ad1065ca4f88071/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.498498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c95d4-2f7d-49df-8f5c-eaedc0bf9bcc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.498886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c95d4-2f7d-49df-8f5c-eaedc0bf9bcc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.499269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c95d4-2f7d-49df-8f5c-eaedc0bf9bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.505817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e4de90a5c942aa86cd9067510b751e, user_id=284a12c61cab45c59ad1065ca4f88071, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.511099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.550464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 862/1735] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:02 2022] PUT /identity/v3/projects/10e4de90a5c942aa86cd9067510b751e/users/284a12c61cab45c59ad1065ca4f88071/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:02.550464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.571623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-308c95d4-2f7d-49df-8f5c-eaedc0bf9bcc None None] MFA Rules not processed for user `5b45e8b15637406eb145ca6e756e1f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:02.574062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-308c95d4-2f7d-49df-8f5c-eaedc0bf9bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.595620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:02.683607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764a01-68b6-48a6-9aa2-7737a8c27ad0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:02.698863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:02.700148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.700148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.700148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.716352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:02.717819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985f1a3-c16d-45b4-8965-02b9121ab59a service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:02.737890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 863/1736] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:02.741017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf859-11df-4c48-a2ed-09753e1fb18a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.741017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf859-11df-4c48-a2ed-09753e1fb18a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.741017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf859-11df-4c48-a2ed-09753e1fb18a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.741399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 864/1737] 10.222.0.47 () {54 vars in 960 bytes} [Wed Jun 29 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:02.744288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 874/1738] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:02.756075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6d2-50a7-4df6-bd2a-79f9e19155d6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.756445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6d2-50a7-4df6-bd2a-79f9e19155d6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.756650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6d2-50a7-4df6-bd2a-79f9e19155d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.756766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.757167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.757641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.783109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-243cd6d2-50a7-4df6-bd2a-79f9e19155d6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:02.784478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-243cd6d2-50a7-4df6-bd2a-79f9e19155d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.793810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:02.795341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.914584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 865/1739] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:02.919300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:02.919594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:02.919888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:02.958097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 875/1740] 10.222.0.47 () {58 vars in 1057 bytes} [Wed Jun 29 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:02.959166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:02.960816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] MFA Rules not processed for user `2020c486ef3e4fceb1d671269668ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:02.962258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.962694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:02.994295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:03.117564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 866/1741] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:03.119743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:03.142311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8811cd-632d-4cd5-8388-9e17d4b44804 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:03.146496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:03.147742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.148348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.148769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.164131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:03.165989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:03.170071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622f336-5add-4e33-9f6a-3a0672d68fd5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:03.183286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:03.184593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.184901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.185180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.186717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 867/1742] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:03.188069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:03.201294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:03.208535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:03.217267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a3a9-a37e-4ed1-9224-46a5c6c3c46c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:03.224138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:03.225183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.225520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.225801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.227893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:03.251020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 876/1743] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:03.254627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:03.256300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:03.299128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 868/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:03.414798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:03.432067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf779-be9d-43fa-a8a0-fa3ec73124cd service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:03.441561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:03.442359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.442654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.442998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.458216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:03.460072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52937a-f888-412b-adbc-d917707339e9 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:03.476008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 877/1745] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:03.714582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:03.716905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:03.744168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97676c-e63b-4a15-ba4b-8c93a82f1dbf service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:03.756304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:03.757781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.758071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.758349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] PATH_INFO: `/v3/projects/fbb5ee6ce3364965881762c4ef989135` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.767716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb5ee6ce3364965881762c4ef989135)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:03.769728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:03.866525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:03.866723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:03.867189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:03.875257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb5ee6ce3364965881762c4ef989135', 'request_id': 'req-bf385f76-66cf-4206-a49b-92a0758149f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:03.900062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb5ee6ce3364965881762c4ef989135', 'request_id': 'req-bf385f76-66cf-4206-a49b-92a0758149f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:03.911537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb5ee6ce3364965881762c4ef989135', 'request_id': 'req-bf385f76-66cf-4206-a49b-92a0758149f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:03.919403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] MFA Rules not processed for user `1c00db02926f4d849249c3990fdf8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:03.921024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:03.940276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:03.965756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] The token cache is being invalidate because project fbb5ee6ce3364965881762c4ef989135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:03.965908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:03.970138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:03.981046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 869/1746] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:03 2022] DELETE /identity/v3/projects/fbb5ee6ce3364965881762c4ef989135 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:03.988113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:03.991873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:04.005116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 878/1747] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:04.018904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:04.021706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:04.171274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385f76-66cf-4206-a49b-92a0758149f6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:04.185325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:04.186471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:04.188509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:04.188509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] PATH_INFO: `/v3/users/93ea974f80be473c9a9413e363e45308` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:04.190123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ea974f80be473c9a9413e363e45308)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:04.194637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:04.251600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5990e-723f-428d-aaa7-5bae75fa3790 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:04.265748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:04.266987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:04.267376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:04.267729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] PATH_INFO: `/v3/projects/fc7cce9e43cb48efb8776e47991afd64` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:04.269755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7cce9e43cb48efb8776e47991afd64)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:04.274999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:04.295669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:04.362060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ea974f80be473c9a9413e363e45308'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.389721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ea974f80be473c9a9413e363e45308'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.392270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ea974f80be473c9a9413e363e45308'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.404548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ea974f80be473c9a9413e363e45308'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.410753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7cce9e43cb48efb8776e47991afd64', 'request_id': 'req-9af63017-746d-42bf-9398-94f590b73f32'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.426884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ea974f80be473c9a9413e363e45308'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.442300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7cce9e43cb48efb8776e47991afd64', 'request_id': 'req-9af63017-746d-42bf-9398-94f590b73f32'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.458017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7cce9e43cb48efb8776e47991afd64', 'request_id': 'req-9af63017-746d-42bf-9398-94f590b73f32'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.464788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 870/1748] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:03 2022] DELETE /identity/v3/users/93ea974f80be473c9a9413e363e45308 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:04.472369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] The token cache is being invalidate because project fc7cce9e43cb48efb8776e47991afd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:04.472519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.474311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-9af63017-746d-42bf-9398-94f590b73f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.487898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 879/1749] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:04 2022] DELETE /identity/v3/projects/fc7cce9e43cb48efb8776e47991afd64 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:04.489722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:04.491745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:04.652522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8753065-35e9-4571-9ef2-1d43066ec22f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:04.669097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:04.670034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:04.670307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:04.670635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] PATH_INFO: `/v3/users/3bce8f3270464e88b6c2070c6d71df33` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:04.676753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bce8f3270464e88b6c2070c6d71df33)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:04.678818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:04.793037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bce8f3270464e88b6c2070c6d71df33'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.810521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bce8f3270464e88b6c2070c6d71df33'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.811399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bce8f3270464e88b6c2070c6d71df33'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.826301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bce8f3270464e88b6c2070c6d71df33'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.860610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-73228064-03a5-4e56-970b-0bae84cfa8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bce8f3270464e88b6c2070c6d71df33'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:04.871264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 871/1750] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:04 2022] DELETE /identity/v3/users/3bce8f3270464e88b6c2070c6d71df33 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:05.502777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:05.503293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:05.503293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:05.536866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] MFA Rules not processed for user `d75d976f2c554209bc4c64d338ad7cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:05.538106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:05.704497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:05.737503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 880/1751] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:06.685880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e929-558a-4967-a180-b894453410d1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:06.686446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e929-558a-4967-a180-b894453410d1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:06.686446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e929-558a-4967-a180-b894453410d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:06.741870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:06.744381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:06.813492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-54b7e929-558a-4967-a180-b894453410d1 None None] MFA Rules not processed for user `284a12c61cab45c59ad1065ca4f88071`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:06.814769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54b7e929-558a-4967-a180-b894453410d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:06.845468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:07.043923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edf47-430d-42bf-ba15-c0cc5e710909 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:07.058709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:07.059619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.059934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.060220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] PATH_INFO: `/v3/projects/b29f676a4c0841239c18108208de50e0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.070344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29f676a4c0841239c18108208de50e0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:07.074120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:07.121898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 872/1752] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:07.122867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e929-558a-4967-a180-b894453410d1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:07.127634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54b7e929-558a-4967-a180-b894453410d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:07.177904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e929-558a-4967-a180-b894453410d1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:07.193237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:07.193933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.194216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.194476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.195189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:07.203035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:07.286922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29f676a4c0841239c18108208de50e0', 'request_id': 'req-183e8b17-a5c4-43e6-87d4-701c46741201'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:07.312606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29f676a4c0841239c18108208de50e0', 'request_id': 'req-183e8b17-a5c4-43e6-87d4-701c46741201'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:07.332151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 873/1753] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:07 2022] POST /identity/v3/projects => generated 403 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:07.333614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29f676a4c0841239c18108208de50e0', 'request_id': 'req-183e8b17-a5c4-43e6-87d4-701c46741201'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:07.337004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:07.414615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] The token cache is being invalidate because project b29f676a4c0841239c18108208de50e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:07.415063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:07.416182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-183e8b17-a5c4-43e6-87d4-701c46741201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:07.426584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 881/1754] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:06 2022] DELETE /identity/v3/projects/b29f676a4c0841239c18108208de50e0 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:07.431349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6029-5f3a-4922-875a-b5b821ccef57 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.431748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6029-5f3a-4922-875a-b5b821ccef57 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.433300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6029-5f3a-4922-875a-b5b821ccef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.511299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-32cc6029-5f3a-4922-875a-b5b821ccef57 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:07.512585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32cc6029-5f3a-4922-875a-b5b821ccef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:07.602421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178715-17d2-45ab-b151-ea2ac5a107a0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:07.624201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:07.626922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.627312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.627477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.662365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:07.674465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:07.799381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 874/1755] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:07 2022] POST /identity/v3/users => generated 308 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:07.800440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:07.806755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:07.868909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 882/1756] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:07.875406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64d80-c454-4987-8c5a-fb713761a04f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:07.880691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.881231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.882524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.895559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:07.896920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.898359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.898680 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.902862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:07.908623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec8cc-6ab8-4957-9222-5e0ddb393678 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:07.940208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 875/1757] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:07.941561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:07.944762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:07.945232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:07.974505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:07.987175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:07.994334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:08.013861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:08.030331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 883/1758] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:08.035716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.092388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952afdc8-c20b-4457-b86c-7255e127720a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.104668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.107417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.107914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.108452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] PATH_INFO: `/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b/users/cd643e8be5e3455abeef133a07850180/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.167832 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 876/1759] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:08.168767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a59f8c34fa4e3caf88e8f65c38a94b, user_id=cd643e8be5e3455abeef133a07850180, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.179385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.184225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.214348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c68056-37ad-4137-b711-7bac53f89451 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.230006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.230828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.231113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.231438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.233227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:08.240621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:08.240860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 884/1760] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:08 2022] PUT /identity/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b/users/cd643e8be5e3455abeef133a07850180/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:08.244138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.245375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.248786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.253458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:08.281009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 877/1761] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:08.285336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.309620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26acf-284b-4f70-9bed-5c77ca544c15 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.476769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.478395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.479177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.480207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.481221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.484506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.522260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb8fea-fb64-4109-b098-fafbcba59033 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.549811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.553550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.553691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 878/1762] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:08 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:08.553785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.554044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.554586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.554811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.559209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:08.564875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.617270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 885/1763] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:10:08.621200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.626693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:08.659316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb63c73-3edb-4a63-b8a7-8d5682aee26f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.714773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836d20-ca03-4049-b2a6-67aaea83a6ed admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.725799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.726709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.727160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.727948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.841755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.842867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.845397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.845885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] PATH_INFO: `/v3/projects/c471ed8f164f46f392da0780b1a7b3ad` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.855242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c471ed8f164f46f392da0780b1a7b3ad)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.857801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.869372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.874788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.901755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 879/1764] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:10:08.902608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:08.930765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664ad1-704b-48e6-84bc-f7b6c2d297f8 service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:08.940997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:08.942616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:08.942930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:08.943175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:08.943946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:08.952214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:08.998752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c471ed8f164f46f392da0780b1a7b3ad', 'request_id': 'req-cb13a1e1-221e-4167-a289-1d5089a79a36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:09.016480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 880/1765] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:08 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:09.016480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:09.032406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c471ed8f164f46f392da0780b1a7b3ad', 'request_id': 'req-cb13a1e1-221e-4167-a289-1d5089a79a36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:09.033941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:09.050449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c471ed8f164f46f392da0780b1a7b3ad', 'request_id': 'req-cb13a1e1-221e-4167-a289-1d5089a79a36'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:09.064186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acaab9-acff-446c-97a2-196078e89290 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:09.112577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] The token cache is being invalidate because project c471ed8f164f46f392da0780b1a7b3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:09.133555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:09.134839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:09.144878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 886/1766] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:08 2022] DELETE /identity/v3/projects/c471ed8f164f46f392da0780b1a7b3ad => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:09.152014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:09.163090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:09.365617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:09.366501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:09.366787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:09.367073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] PATH_INFO: `/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b/users/cd643e8be5e3455abeef133a07850180/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:09.372693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a59f8c34fa4e3caf88e8f65c38a94b, user_id=cd643e8be5e3455abeef133a07850180, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:09.387079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:09.389094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2091cc-fe20-4d13-8d51-3189071beb6c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:09.444653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 881/1767] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:09 2022] PUT /identity/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b/users/cd643e8be5e3455abeef133a07850180/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:09.448596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eca0a-0063-49be-bc67-45181e5410b5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:09.448596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eca0a-0063-49be-bc67-45181e5410b5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:09.448596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eca0a-0063-49be-bc67-45181e5410b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:09.537285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b04eca0a-0063-49be-bc67-45181e5410b5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:09.538534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b04eca0a-0063-49be-bc67-45181e5410b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:09.624555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a1e1-221e-4167-a289-1d5089a79a36 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:09.923966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:09.924664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:09.924946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:09.926918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:09.932292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:09.934012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:09.959048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 882/1768] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:09.964983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0325-935c-44d9-9417-d6042594d1af None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:09.968609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0325-935c-44d9-9417-d6042594d1af None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:09.969377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0325-935c-44d9-9417-d6042594d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:09.984244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 887/1769] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 838 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:09.985512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.029659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73917-a5ab-4bc7-b301-524dcdb84814 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.051513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-238e0325-935c-44d9-9417-d6042594d1af None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:10.052935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.053902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.054394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-238e0325-935c-44d9-9417-d6042594d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:10.054753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.055905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.059297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.069598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:10.073254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 883/1770] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:10.078295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0325-935c-44d9-9417-d6042594d1af None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.104104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0325-935c-44d9-9417-d6042594d1af None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.115195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 888/1771] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:10.118145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.132303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.142535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.144402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.145311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.147635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:10.149173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.151303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:10.173952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417121d8-27bf-4507-b756-cae683f9c34d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.196726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.201198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.204757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.206020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] PATH_INFO: `/v3/projects/6fa052481d7a4a2684095a56a4759525/users/fcf810f208a9493ba60370afa5e7b465/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.222403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 884/1772] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:10.227151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.260917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa052481d7a4a2684095a56a4759525, user_id=fcf810f208a9493ba60370afa5e7b465, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.275082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1375-981c-45e3-8c01-047f7eeb9402 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:10.298962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e574e33-85b3-48d0-a259-61de29b2d1e3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.322650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 889/1773] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:10 2022] PUT /identity/v3/projects/6fa052481d7a4a2684095a56a4759525/users/fcf810f208a9493ba60370afa5e7b465/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:10.325141 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.326718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.328820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.410366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] MFA Rules not processed for user `fcf810f208a9493ba60370afa5e7b465`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:10.419369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:10.514702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.515999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.519518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.520151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.522700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.527815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:10.681331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 885/1774] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:10 2022] POST /identity/v3/projects => generated 375 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:10.686493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.706422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:10.802255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 890/1775] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:10.803842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:10.830311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dfb0e-d73d-4b13-8954-ebde8dd57e06 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.886159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:10.935352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a5b3-7e05-441f-a4d3-24cb86395197 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:10.947429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.949647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.950051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.950266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.951068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.963853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:10.979131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:10.980259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:10.980554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:10.980836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:10.981737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:10.989577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.021460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 886/1776] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:10 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:11.028662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.062028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e2c4b-693d-479b-ae43-6afefab8e3c2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.070257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.070687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.071040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.071321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.072284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.074058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.074762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 891/1777] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:10 2022] POST /identity/v3/projects => generated 377 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:11.079776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.113622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 887/1778] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:11.118083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.146124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea406f39-4a7f-4cb1-8cc2-22e0556dcfc9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.254009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.254959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.255550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.263128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.263968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.266221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.271672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272f719-49ca-4eb5-9e46-4aef763b563e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.278063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.278788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.279072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.279347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.280442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.282314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.284899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 888/1779] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:11.289395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.302363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a125-b406-4067-b112-2b86aaf21fa7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.309048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.310190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.310527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.310830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] PATH_INFO: `/v3/projects/d36c6bdf4d654e8292ff3f7ddebdb8d9/users/a0a563fe8b59417f9da34435eda7f505/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.338854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36c6bdf4d654e8292ff3f7ddebdb8d9, user_id=a0a563fe8b59417f9da34435eda7f505, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.342040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511de05-e4a7-40f7-98c0-beab82c2ec57 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.365924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 892/1780] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:11 2022] POST /identity/v3/users => generated 295 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:11.376251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 889/1781] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:11 2022] PUT /identity/v3/projects/d36c6bdf4d654e8292ff3f7ddebdb8d9/users/a0a563fe8b59417f9da34435eda7f505/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:11.376485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.382410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.382815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.383078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.396770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7448947-e03e-4eac-bab1-a0f0cee4a4ac admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.496958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] MFA Rules not processed for user `a0a563fe8b59417f9da34435eda7f505`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:11.498243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:11.564886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:11.582456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.583338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.583583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.583874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.584751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.586597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.600579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 890/1782] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:11.615039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 893/1783] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:11.615377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.624118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.637588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ffdc4-8571-4646-8b79-3e29cb834da4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.647563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.648625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.649110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.649631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.655295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.659516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.669009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1535b-1fd4-4a00-8cd2-c145595148b8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:11.694965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:11.696046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:11.697069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:11.697354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] PATH_INFO: `/v3/projects/e0d452221984409bb4b618251e8161a1/users/859d0f6784e841e6a9382063f7de127a/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:11.720407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d452221984409bb4b618251e8161a1, user_id=859d0f6784e841e6a9382063f7de127a, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:11.727379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:11.759644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 891/1784] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:11.768008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.778909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 894/1785] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:11 2022] PUT /identity/v3/projects/e0d452221984409bb4b618251e8161a1/users/859d0f6784e841e6a9382063f7de127a/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:11.783421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:11.830192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:11.972023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63744b9-7d94-4642-adca-16dd4fba4bc3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.003402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85031b7-67ce-448c-9da7-9433ccb6dd59 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.019299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.020763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.021232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.024705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.027120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.030819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.084661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 895/1786] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:12.093168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.159023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f25b5-1f97-4fe7-be00-19dcbabbef23 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.181395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.188784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.190339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.191167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] PATH_INFO: `/v3/projects/e0d452221984409bb4b618251e8161a1/users/859d0f6784e841e6a9382063f7de127a/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.197279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d452221984409bb4b618251e8161a1, user_id=859d0f6784e841e6a9382063f7de127a, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.207891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b544f-3327-490f-8ad2-3ee5932ce0ee admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.223355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.224057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.224343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.225335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.228549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.238741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.250592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 896/1787] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:12 2022] PUT /identity/v3/projects/e0d452221984409bb4b618251e8161a1/users/859d0f6784e841e6a9382063f7de127a/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:12.261034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.261875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.262372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.301380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 892/1788] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:11 2022] POST /identity/v3/users => generated 294 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:12.302755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.316157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] MFA Rules not processed for user `859d0f6784e841e6a9382063f7de127a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:12.316157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:12.329620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091ea13-a99a-4c2e-925f-d7f7a92bd30c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.441883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:12.464773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.467533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.467919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.468894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.469666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.477902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.528200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 897/1789] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:12.535505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 893/1790] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:12.540180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.550707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.553632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:12.568493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731ecb-e4f2-48b3-a625-ac1aeddbec48 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.582381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.583461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.584708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.585415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] PATH_INFO: `/v3/projects/6ed957de80ae4505b8639c4ab1b7797a/users/276cea6eee464763b04d9f6bca12a247/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.610157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed957de80ae4505b8639c4ab1b7797a, user_id=276cea6eee464763b04d9f6bca12a247, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.613488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.653484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 898/1791] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:12 2022] PUT /identity/v3/projects/6ed957de80ae4505b8639c4ab1b7797a/users/276cea6eee464763b04d9f6bca12a247/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:12.655333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.731808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c5cc-b121-4420-8e38-c2fe209561a3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.827426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:12.849561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666d99-768f-4c11-9bba-04845d1e2bfe admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.859859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.860849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.861318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.862171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.863137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.865246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:12.896012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.896637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 899/1792] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:12.896753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.897053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.897336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.898834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:12.920325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716ebc7-9afa-4296-b384-286bb4dfe350 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:12.927579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:12.928737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:12.929516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:12.930735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] PATH_INFO: `/v3/projects/6ed957de80ae4505b8639c4ab1b7797a/users/276cea6eee464763b04d9f6bca12a247/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:12.957543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed957de80ae4505b8639c4ab1b7797a, user_id=276cea6eee464763b04d9f6bca12a247, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:12.964979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f04fc-6a06-41fe-9dc2-c2b34c245390 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:13.000621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 900/1793] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:12 2022] PUT /identity/v3/projects/6ed957de80ae4505b8639c4ab1b7797a/users/276cea6eee464763b04d9f6bca12a247/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:13.013753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36e57-f41f-49ef-8ea3-77261ecbb909 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:13.014325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36e57-f41f-49ef-8ea3-77261ecbb909 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:13.014764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36e57-f41f-49ef-8ea3-77261ecbb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:13.053260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:13.055848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:13.075458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 894/1794] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:13.115749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-82f36e57-f41f-49ef-8ea3-77261ecbb909 None None] MFA Rules not processed for user `276cea6eee464763b04d9f6bca12a247`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:13.118038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82f36e57-f41f-49ef-8ea3-77261ecbb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:13.397916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 901/1795] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:13.416316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:13.418659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:13.450644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59a47-02d1-442c-ae8e-65e0b3ddc303 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:13.748085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:13.749562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:13.750107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:13.750664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:13.830468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:14.101013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:14.109947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b595df4-9263-49c5-a5ec-ed4a599da7b9 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:14.167052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:14.167547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:14.169916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:14.172066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 895/1796] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:14.325006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:14.334889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:14.620038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8df72-08dd-4ac4-9546-305a4c087058 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:14.620705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8df72-08dd-4ac4-9546-305a4c087058 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:14.622346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8df72-08dd-4ac4-9546-305a4c087058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:14.622590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 902/1797] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Jun 29 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:14.707623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-91a8df72-08dd-4ac4-9546-305a4c087058 None None] MFA Rules not processed for user `2020c486ef3e4fceb1d671269668ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:14.710489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91a8df72-08dd-4ac4-9546-305a4c087058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:14.973048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:14.976003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:14.976152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 896/1798] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:15.003208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de0b9-8f44-4687-9970-c8761e8c260b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:15.012268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:15.016645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:15.017068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:15.017457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:15.035956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:15.043751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:15.068936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 903/1799] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:15.107035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89b00-e6c3-4821-a030-31afb010d830 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:15.109609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89b00-e6c3-4821-a030-31afb010d830 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:15.110039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d89b00-e6c3-4821-a030-31afb010d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:15.148111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-40d89b00-e6c3-4821-a030-31afb010d830 None None] MFA Rules not processed for user `5b45e8b15637406eb145ca6e756e1f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:15.148111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-40d89b00-e6c3-4821-a030-31afb010d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:15.275889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 897/1800] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:15.328669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:15.349065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd414-683b-4091-ab8d-85029b5cadcc service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:15.364765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:15.365836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:15.366528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:15.367122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:15.389862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:15.392959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe080-4092-40bd-910b-1aac4efbd41a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:15.447438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 904/1801] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:18.414049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9edce-66f4-4bde-9116-20b9086b0868 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:18.414544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9edce-66f4-4bde-9116-20b9086b0868 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:18.414811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9edce-66f4-4bde-9116-20b9086b0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:18.461981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-42c9edce-66f4-4bde-9116-20b9086b0868 None None] MFA Rules not processed for user `cd643e8be5e3455abeef133a07850180`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:18.464795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-42c9edce-66f4-4bde-9116-20b9086b0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:18.646801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:18.668570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 898/1802] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:19.590139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62da5-36ed-4237-bec3-f652ccde3b62 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:19.590639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62da5-36ed-4237-bec3-f652ccde3b62 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:19.590736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62da5-36ed-4237-bec3-f652ccde3b62 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:19.593483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 905/1803] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:19.619753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e4b8-cb2d-4a4c-92ea-e4e9cd54a67b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:19.620718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e4b8-cb2d-4a4c-92ea-e4e9cd54a67b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:19.620718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e4b8-cb2d-4a4c-92ea-e4e9cd54a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:19.652972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b496e4b8-cb2d-4a4c-92ea-e4e9cd54a67b None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:19.654209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b496e4b8-cb2d-4a4c-92ea-e4e9cd54a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:19.913455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 899/1804] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:20.058638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:20.058933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:20.059389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:20.061332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 906/1805] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:20.113399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:20.114020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:20.114449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:20.147605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:20.148841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:20.242926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:20.246081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:20.292108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5df118-715d-4fe2-92ba-1d294b20ea12 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:20.302816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:20.303722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:20.304200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:20.304634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:20.323645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:20.325647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:20.372297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 907/1807] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:20.372418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 900/1807] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:20.399381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:20.400946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:20.419091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e417-7740-4131-87b0-194f657f8767 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:20.425368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:20.425885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:20.426264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:20.426620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:20.448129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:20.449969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:20.488026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 901/1808] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:21.093185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:21.094723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:21.131518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:21.165153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69302-a105-4cbe-b20f-fac8cfb59472 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:21.170456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:21.171903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:21.172200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:21.172474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] PATH_INFO: `/v3/users/284a12c61cab45c59ad1065ca4f88071` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:21.173762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284a12c61cab45c59ad1065ca4f88071)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:21.175672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:21.224075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284a12c61cab45c59ad1065ca4f88071'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.231210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284a12c61cab45c59ad1065ca4f88071'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.231839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284a12c61cab45c59ad1065ca4f88071'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.232435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284a12c61cab45c59ad1065ca4f88071'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.239758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284a12c61cab45c59ad1065ca4f88071'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.257472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 908/1809] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:21 2022] DELETE /identity/v3/users/284a12c61cab45c59ad1065ca4f88071 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:21.471299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:21.482427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd187c-431b-432f-a4f4-2e7c6797efa4 service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:21.542937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:21.543726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:21.544111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:21.544388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] PATH_INFO: `/v3/projects/10e4de90a5c942aa86cd9067510b751e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:21.545578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e4de90a5c942aa86cd9067510b751e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:21.547644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:21.558392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:21.594296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e4de90a5c942aa86cd9067510b751e', 'request_id': 'req-5a060696-f6c1-4a53-b6a0-10f853ba6620'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.601379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e4de90a5c942aa86cd9067510b751e', 'request_id': 'req-5a060696-f6c1-4a53-b6a0-10f853ba6620'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.607670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e4de90a5c942aa86cd9067510b751e', 'request_id': 'req-5a060696-f6c1-4a53-b6a0-10f853ba6620'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.618978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] The token cache is being invalidate because project 10e4de90a5c942aa86cd9067510b751e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:21.619268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.619958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.621782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 902/1810] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:21 2022] DELETE /identity/v3/projects/10e4de90a5c942aa86cd9067510b751e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:21.625906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:21.627435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:21.641709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007507-6299-40c1-8647-addcc1d5e0f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:21.698643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:21.699604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:21.699945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:21.700222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] PATH_INFO: `/v3/users/cd643e8be5e3455abeef133a07850180` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:21.701402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd643e8be5e3455abeef133a07850180)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:21.703324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:21.754462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd643e8be5e3455abeef133a07850180'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.762887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd643e8be5e3455abeef133a07850180'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.763654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd643e8be5e3455abeef133a07850180'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.764290 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd643e8be5e3455abeef133a07850180'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.766020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:21.776610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-10b2bc89-d6e3-4a20-bf65-edcd28d97846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd643e8be5e3455abeef133a07850180'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:21.800634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 909/1811] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:21 2022] DELETE /identity/v3/users/cd643e8be5e3455abeef133a07850180 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:22.020938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.022745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:22.038502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a060696-f6c1-4a53-b6a0-10f853ba6620 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.108516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.110197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.110482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.110760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] PATH_INFO: `/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.112067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a59f8c34fa4e3caf88e8f65c38a94b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.114048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.164556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a59f8c34fa4e3caf88e8f65c38a94b', 'request_id': 'req-03485469-ec30-48bc-ad9d-4e9bdcde37bd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:22.174578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a59f8c34fa4e3caf88e8f65c38a94b', 'request_id': 'req-03485469-ec30-48bc-ad9d-4e9bdcde37bd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:22.182822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a59f8c34fa4e3caf88e8f65c38a94b', 'request_id': 'req-03485469-ec30-48bc-ad9d-4e9bdcde37bd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:22.193876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] The token cache is being invalidate because project 25a59f8c34fa4e3caf88e8f65c38a94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:22.194163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:22.194942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-03485469-ec30-48bc-ad9d-4e9bdcde37bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:22.196565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 903/1812] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:22 2022] DELETE /identity/v3/projects/25a59f8c34fa4e3caf88e8f65c38a94b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:22.201886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.202495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.202495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.224217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:22.225440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:22.288411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 910/1813] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:22.296241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.296559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.296864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.315779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:22.316968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:22.325086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 904/1814] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:22.330339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.340220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf917732-1e76-4490-a43e-e35efb2e2bdd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.345650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.346431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.346822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.347100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.347986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:22.348295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.350765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.364416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 911/1815] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:22.368658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.378697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876716c2-ede1-4bb0-9f96-7e9cd9beb50b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.383557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.384252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.384536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.384914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.385610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.387513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.413369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:22.424705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 905/1816] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:22.426701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.443008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddf1d4-379e-42d8-bd2c-fa6e844d9f76 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.512537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.513346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.513615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.513890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.514580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.517072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.539615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 912/1817] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:22.543627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.560408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e697-ceac-4eca-b5f3-0db270e424d3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.567149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.568035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.568382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.568662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.569479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.571190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.583141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 906/1818] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:22.588402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.602385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6578-f4e3-4e41-8814-9043d18eca1d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.608210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.608930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.609212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.609486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.610333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.616651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d488ad-3c6c-4500-b12a-127a7c49504f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.637738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 913/1819] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:22.642359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.652627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc617-d11a-4c43-993e-c179a4ed4b6d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.659191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.660115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.660333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.660610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] PATH_INFO: `/v3/projects/02d676c9591f48eeaf6be45284516fa6/users/bc711f39af5041af84e80f3d69f319a0/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.676169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d676c9591f48eeaf6be45284516fa6, user_id=bc711f39af5041af84e80f3d69f319a0, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.678868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.696171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 907/1820] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:22 2022] PUT /identity/v3/projects/02d676c9591f48eeaf6be45284516fa6/users/bc711f39af5041af84e80f3d69f319a0/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:22.708504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.709064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.709446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.736656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] MFA Rules not processed for user `bc711f39af5041af84e80f3d69f319a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:22.737865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:22.768591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:22.812932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 914/1821] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:22.817324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.884167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f495-bdc6-4ee5-b79e-44155fd7632b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.889374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.895127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.895127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.895127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:22.895127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:22.895127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:22.922885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 908/1822] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:22.927410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:22.939851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdb1b-0199-477d-a931-c860bbac9cdc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:22.998149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:22.998828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:22.999119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:22.999965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.000676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.002666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.023861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 915/1823] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:22 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:23.027939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.040497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6455f5b-90b9-4fd2-b008-e6133080d569 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.045516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.046179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.047003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.048522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.048522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.049658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.060718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 909/1824] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:23.065500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.076448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d237f7-f0d8-40ce-bc31-8caf1f56b182 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.081509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.082411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.082692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.082969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] PATH_INFO: `/v3/projects/c2757d70572d4f87906776fafa6b31f7/users/5f481e9d5f9a4f899cac33bbed9f771d/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.100076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2757d70572d4f87906776fafa6b31f7, user_id=5f481e9d5f9a4f899cac33bbed9f771d, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.102751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.118461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 916/1825] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:23 2022] PUT /identity/v3/projects/c2757d70572d4f87906776fafa6b31f7/users/5f481e9d5f9a4f899cac33bbed9f771d/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:23.123537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.141999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cdf0a-3461-41cf-9cf6-390599449d35 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.196885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.197549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.197834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.198113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.198839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.200507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d652ddb-63e8-46fe-aa96-f874a29ca720 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.210617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 910/1826] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:23.214809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.226596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051746-01fb-4887-b1d0-4aa056325277 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.231565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.232506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.232792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.233074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] PATH_INFO: `/v3/projects/c2757d70572d4f87906776fafa6b31f7/users/5f481e9d5f9a4f899cac33bbed9f771d/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.235638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2757d70572d4f87906776fafa6b31f7, user_id=5f481e9d5f9a4f899cac33bbed9f771d, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.238403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.259997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 917/1827] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:23 2022] PUT /identity/v3/projects/c2757d70572d4f87906776fafa6b31f7/users/5f481e9d5f9a4f899cac33bbed9f771d/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:23.270341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.271234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.271529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.319123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] MFA Rules not processed for user `5f481e9d5f9a4f899cac33bbed9f771d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:23.320445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:23.347979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:23.399761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 911/1828] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:23.411664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.413329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:23.479938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650c08-48b4-426d-a8e0-a5dd70a89cf7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.483650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.484333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.484614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.484893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.494356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.496096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.510357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 918/1829] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:23.615700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:23.627101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962de9-4a5c-49fe-995d-d59f5d1ed97c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:23.631051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:23.631837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:23.633751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:23.634165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:23.704916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:23.706634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43294b71-1580-4d66-9969-c4d4489860ff service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:23.720948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 912/1830] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:24.369570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:24.371308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:24.403874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:24.459757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e78fa-d984-4aaf-99fe-f234833ed399 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:24.464912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:24.465809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:24.466088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:24.466357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] PATH_INFO: `/v3/users/a0a563fe8b59417f9da34435eda7f505` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:24.467577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a563fe8b59417f9da34435eda7f505)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:24.470100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:24.540254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a563fe8b59417f9da34435eda7f505'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:24.556460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a563fe8b59417f9da34435eda7f505'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:24.557361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a563fe8b59417f9da34435eda7f505'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:24.557974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a563fe8b59417f9da34435eda7f505'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:24.565545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a563fe8b59417f9da34435eda7f505'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:24.583606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 919/1831] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:24 2022] DELETE /identity/v3/users/a0a563fe8b59417f9da34435eda7f505 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:24.588297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:24.588593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:24.589005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:24.606389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:24.607658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:24.689244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 913/1832] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:24.698925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:24.700489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:24.755532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:24.756979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:24.767748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d97b3-924e-4911-a4a2-fb575f58001e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:24.772202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:24.773007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:24.773406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:24.773856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:24.792360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:24.799138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:24.814991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 920/1833] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:24.833819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6a8f7-e90d-4002-91b6-881984f37919 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:24.838083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:24.838925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:24.839229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:24.839971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:24.841815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:24.857248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:24.937346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:24.939895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:24.955518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 914/1834] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:25.354182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:25.356378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:25.393966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec24d-e235-43fa-8c90-c185de6bc246 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:25.420531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:25.422706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:25.422994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:25.423272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] PATH_INFO: `/v3/projects/d36c6bdf4d654e8292ff3f7ddebdb8d9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:25.425909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36c6bdf4d654e8292ff3f7ddebdb8d9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:25.434553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:25.562529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:25.584835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36c6bdf4d654e8292ff3f7ddebdb8d9', 'request_id': 'req-d345f148-333e-4d7c-b221-0396ba45ab1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.596337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36c6bdf4d654e8292ff3f7ddebdb8d9', 'request_id': 'req-d345f148-333e-4d7c-b221-0396ba45ab1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.607010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36c6bdf4d654e8292ff3f7ddebdb8d9', 'request_id': 'req-d345f148-333e-4d7c-b221-0396ba45ab1b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.634480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] The token cache is being invalidate because project d36c6bdf4d654e8292ff3f7ddebdb8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:25.634839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.635559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.637383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 921/1835] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:25 2022] DELETE /identity/v3/projects/d36c6bdf4d654e8292ff3f7ddebdb8d9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:25.641638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:25.663405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139b67-6264-4a29-896a-54b09a71189d service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:25.744313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:25.747144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:25.748817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:25.749109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] PATH_INFO: `/v3/users/276cea6eee464763b04d9f6bca12a247` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:25.751803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=276cea6eee464763b04d9f6bca12a247)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:25.756049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:25.853099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276cea6eee464763b04d9f6bca12a247'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.861580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276cea6eee464763b04d9f6bca12a247'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.862562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276cea6eee464763b04d9f6bca12a247'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.873687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276cea6eee464763b04d9f6bca12a247'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.892741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5e47e447-35aa-4d6b-8ed7-deb9a43ff2ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276cea6eee464763b04d9f6bca12a247'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:25.900259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 915/1836] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:25 2022] DELETE /identity/v3/users/276cea6eee464763b04d9f6bca12a247 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:26.225303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.226764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:26.252783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345f148-333e-4d7c-b221-0396ba45ab1b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.342157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.343053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.343340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.343618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] PATH_INFO: `/v3/projects/6ed957de80ae4505b8639c4ab1b7797a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.344829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed957de80ae4505b8639c4ab1b7797a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.346730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.403295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed957de80ae4505b8639c4ab1b7797a', 'request_id': 'req-38b6c3f7-0717-472e-8ddb-ca9758e62713'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:26.413652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed957de80ae4505b8639c4ab1b7797a', 'request_id': 'req-38b6c3f7-0717-472e-8ddb-ca9758e62713'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:26.421034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed957de80ae4505b8639c4ab1b7797a', 'request_id': 'req-38b6c3f7-0717-472e-8ddb-ca9758e62713'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:26.438606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] The token cache is being invalidate because project 6ed957de80ae4505b8639c4ab1b7797a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:26.438969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:26.439566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38b6c3f7-0717-472e-8ddb-ca9758e62713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:26.441402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 922/1837] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:26 2022] DELETE /identity/v3/projects/6ed957de80ae4505b8639c4ab1b7797a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:26.447540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.447859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.448151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.465349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:26.466584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:26.497131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:26.554068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 916/1838] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:26.556113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.556404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.556680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.575502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:26.576714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:26.587033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 923/1839] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:26.600932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.615816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ec8c1-c39a-49aa-a870-bfad2afa5658 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.621172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.621849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.622138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.622417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.623157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:26.623469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.625169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.639529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 917/1840] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:26.643948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.653563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773618f-b516-49f7-8d2f-990f6a133ced None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.659125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.659873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.660223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.660574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.661359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.663680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.698456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 924/1841] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:26 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:26.703036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.738743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2980-05cf-4e49-92b0-30dedef97a17 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.829605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.830286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.830565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.830844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.831638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.833711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.865523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 918/1842] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:26 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:26.872021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.884879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da282133-6741-4a14-8872-d23652ffb4be admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.907909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.908670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.909042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.909369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.909964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.913554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.927944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 925/1843] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:26.929109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.939390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175df4c-18fd-43c5-9725-87d600865f31 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.944485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.945286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.945641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.946010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.946824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:26.948547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:26.963529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 919/1844] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:26.964946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.977784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22657df6-1396-4e11-a8fa-99c27431e2bc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:26.982664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:26.983799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:26.984017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:26.984296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] PATH_INFO: `/v3/projects/ecc70a11224b4bcab1a8ccb9e3db815b/users/2e2d8e7c5d334c05ae06d7ab48e60205/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:26.992108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:26.994141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.001037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc70a11224b4bcab1a8ccb9e3db815b, user_id=2e2d8e7c5d334c05ae06d7ab48e60205, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.003797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db444aa-2af7-4327-a348-29e919c26be3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.006367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:27.009694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601ffb-b71c-47d0-b1f3-e9fabd101e17 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:27.014714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:27.018162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.018162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.018162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] PATH_INFO: `/v3/users/bc711f39af5041af84e80f3d69f319a0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.018859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc711f39af5041af84e80f3d69f319a0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.021317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.029753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 926/1845] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:26 2022] PUT /identity/v3/projects/ecc70a11224b4bcab1a8ccb9e3db815b/users/2e2d8e7c5d334c05ae06d7ab48e60205/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:27.040160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.040453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.040736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.067090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] MFA Rules not processed for user `2e2d8e7c5d334c05ae06d7ab48e60205`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:27.068354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.071665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc711f39af5041af84e80f3d69f319a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.081173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc711f39af5041af84e80f3d69f319a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.081941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc711f39af5041af84e80f3d69f319a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.090136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc711f39af5041af84e80f3d69f319a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.103455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f2bb7538-426c-4b35-9851-33dec2b5e18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc711f39af5041af84e80f3d69f319a0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.109522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 920/1846] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:26 2022] DELETE /identity/v3/users/bc711f39af5041af84e80f3d69f319a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:27.113793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.114114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.114396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.126004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:27.131784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:27.133771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.141600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 927/1847] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:27.152621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:27.153989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.196998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 921/1848] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:27.207545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:27.208944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.214631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f469e7-65d0-4d8c-8f8e-229d95e65842 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:27.263658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:27.264321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3400cf5-576e-4b83-9c4a-6fa97df2f348 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:27.264457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.264621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.264914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.269655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:27.270685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.271213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.271737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.282627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.284255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.294205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 922/1849] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:27.319051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:27.322700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.324107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.347407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 928/1850] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:27.581847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:27.583844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:27.600840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc3f3-e633-4d8e-a9e6-62517838453c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:27.607212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:27.609332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.609767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.619546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] PATH_INFO: `/v3/projects/02d676c9591f48eeaf6be45284516fa6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.623263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d676c9591f48eeaf6be45284516fa6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.628370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.691867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d676c9591f48eeaf6be45284516fa6', 'request_id': 'req-8d5a7672-1552-4563-908d-22cbc09b4029'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.700276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d676c9591f48eeaf6be45284516fa6', 'request_id': 'req-8d5a7672-1552-4563-908d-22cbc09b4029'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.709244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d676c9591f48eeaf6be45284516fa6', 'request_id': 'req-8d5a7672-1552-4563-908d-22cbc09b4029'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.721334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] The token cache is being invalidate because project 02d676c9591f48eeaf6be45284516fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:27.721826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.722747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.724623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 923/1851] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:27 2022] DELETE /identity/v3/projects/02d676c9591f48eeaf6be45284516fa6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:27.736967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:27.743677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7439396-d9df-44ce-a9d7-c4d2e2e41330 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:27.803945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:27.804825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:27.805105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:27.805378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] PATH_INFO: `/v3/users/5f481e9d5f9a4f899cac33bbed9f771d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:27.806556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f481e9d5f9a4f899cac33bbed9f771d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:27.808532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:27.866645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f481e9d5f9a4f899cac33bbed9f771d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.876876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f481e9d5f9a4f899cac33bbed9f771d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.877579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f481e9d5f9a4f899cac33bbed9f771d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.878267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f481e9d5f9a4f899cac33bbed9f771d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.886063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-103f8913-d3c2-4464-93d1-2c76a1d5913b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f481e9d5f9a4f899cac33bbed9f771d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:27.907506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 929/1852] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:27 2022] DELETE /identity/v3/users/5f481e9d5f9a4f899cac33bbed9f771d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:28.419087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.420729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:28.433760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7672-1552-4563-908d-22cbc09b4029 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.464919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:28.493123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.493985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.494267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.494544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] PATH_INFO: `/v3/projects/c2757d70572d4f87906776fafa6b31f7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.496001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2757d70572d4f87906776fafa6b31f7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.497900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.547843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2757d70572d4f87906776fafa6b31f7', 'request_id': 'req-a1641f9d-81b6-4d95-b226-891b607135f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:28.555301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2757d70572d4f87906776fafa6b31f7', 'request_id': 'req-a1641f9d-81b6-4d95-b226-891b607135f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:28.562542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2757d70572d4f87906776fafa6b31f7', 'request_id': 'req-a1641f9d-81b6-4d95-b226-891b607135f6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:28.573119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] The token cache is being invalidate because project c2757d70572d4f87906776fafa6b31f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:28.573402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:28.574044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1641f9d-81b6-4d95-b226-891b607135f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:28.575614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 924/1853] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:28 2022] DELETE /identity/v3/projects/c2757d70572d4f87906776fafa6b31f7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:28.581698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.581987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.582263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.599524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:28.600780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:28.661581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 930/1854] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:28.668955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.669445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.669725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.693075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:28.694323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:28.702438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 925/1855] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:28.706569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.716184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d989fad-3e64-4803-9823-5b7146b85314 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.721217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.721861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.722139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.722415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.723149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:28.723453 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.725067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.733766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:28.739994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 931/1856] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:28.744905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.755014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb675-730b-420d-9f98-7de694d5d944 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.760673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.761504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.762110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.762791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.763085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.765819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.797473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 926/1857] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:28 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:28.798691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.808971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a47cfb-933e-4b40-a39d-c3944ba2d72b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.866377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.867253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.867638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.867975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.868767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.871381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.890366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 932/1858] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:28 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:28.894883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.907128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0258-8f62-41c7-9cd5-8c3fec3566ea admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.911871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.912474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.912755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.913025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.913769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.915340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.927720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 927/1859] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:10:28.931788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.941776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7b70a-a139-478b-b344-1205a4e9e083 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.946452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.947112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.947397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.947673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.948428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:28.950011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a7397-4056-4d1a-8e95-9f3ad4e276bf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:28.963634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 933/1860] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:10:28.965010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:28.975519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547d553-1c66-48b3-9ed9-8c90e3f6ec81 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:28.980295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:28.981185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:28.981467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:28.981743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] PATH_INFO: `/v3/projects/d8169b97858b4114b01a9eaf8ac49b03/users/907ffd7570ec4905a49458b57c4013eb/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:28.997458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8169b97858b4114b01a9eaf8ac49b03, user_id=907ffd7570ec4905a49458b57c4013eb, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.000134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.012906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 928/1861] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:28 2022] PUT /identity/v3/projects/d8169b97858b4114b01a9eaf8ac49b03/users/907ffd7570ec4905a49458b57c4013eb/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:10:29.024788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.025078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.025383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.053522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] MFA Rules not processed for user `907ffd7570ec4905a49458b57c4013eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:29.054779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:29.120143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 934/1862] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:29.124863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.187170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea953d-2be8-4d4a-9586-67a2c98d20b2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.191588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.192339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.192621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.192891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.193582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.195460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.198686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:29.224218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 929/1863] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:29.228459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.239397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59729-0b0c-4c34-8a55-640f2c567a9d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.296337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.297010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.297317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.297591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.298284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.300274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.313354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:29.319649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 935/1864] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:29.323464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.334155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa3b09-6cbb-494f-ad56-cb4d6bb9093b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.338701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.339345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.339625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.339934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.340650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.342320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.353507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 930/1865] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:29.357186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.366905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6fa16-9670-4982-80e2-ea126d94afd8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.371882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.372558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.372839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.373113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.373831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.375441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cf0c8-e9a1-4709-bfac-6ee28d57571e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.385798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 936/1866] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:29.389786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.400036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bcc7f-fa0e-4a14-a27d-10f7417a3881 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.404850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.406281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.406564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.406837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] PATH_INFO: `/v3/projects/0582402e455d42af9f943c586eb8ecaa/users/f6222598288441eaa14f22c2b16b20c0/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.421320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0582402e455d42af9f943c586eb8ecaa, user_id=f6222598288441eaa14f22c2b16b20c0, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.423968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.436600 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 931/1867] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:29 2022] PUT /identity/v3/projects/0582402e455d42af9f943c586eb8ecaa/users/f6222598288441eaa14f22c2b16b20c0/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:29.446938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.447229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.447511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.474035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] MFA Rules not processed for user `f6222598288441eaa14f22c2b16b20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:29.475255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:29.538027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 937/1868] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:29.542616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.603014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a2e1-886c-46fd-a0f2-61d93e043e86 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.607735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.608491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.608763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.609034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.609727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.611611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.639564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 932/1869] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:10:29.641774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.654955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24b74d-af37-4410-b3ad-395d0902789c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.714509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.715130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.715414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.715692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.716520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.718523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.738155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 938/1870] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:29.742211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.753268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b7c5-ca75-423a-9bda-bc87c3f63b3b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.758136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.758879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.759163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.759437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.760263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.761852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.773163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 933/1871] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:29.777348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.788248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1978b-e87a-4cc6-a9e3-de621888f0ab admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.793685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.794725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.795013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.795296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] PATH_INFO: `/v3/projects/5fbe668b5e494fa3bee1a22090c5635c/users/a1b2f388eb2447eeae1d6e129f4b3004/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.816512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbe668b5e494fa3bee1a22090c5635c, user_id=a1b2f388eb2447eeae1d6e129f4b3004, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.819303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.839503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 939/1872] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:29 2022] PUT /identity/v3/projects/5fbe668b5e494fa3bee1a22090c5635c/users/a1b2f388eb2447eeae1d6e129f4b3004/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:29.840731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.852875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a18e-aeb8-4762-8482-8b3540290926 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.926264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.927047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.927331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.927634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.928470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.930063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc32544-75ba-4e3b-8fd8-e71c51313a98 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.940488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 934/1873] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:29.944602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:29.954956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b67e2-bf53-425b-a316-13749c9a56ad admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:29.959636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:29.960551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.960837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.961109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] PATH_INFO: `/v3/projects/5fbe668b5e494fa3bee1a22090c5635c/users/a1b2f388eb2447eeae1d6e129f4b3004/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:29.963087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbe668b5e494fa3bee1a22090c5635c, user_id=a1b2f388eb2447eeae1d6e129f4b3004, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:29.965726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:29.975958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 940/1874] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:29 2022] PUT /identity/v3/projects/5fbe668b5e494fa3bee1a22090c5635c/users/a1b2f388eb2447eeae1d6e129f4b3004/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:29.987311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:29.987608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:29.987941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:30.014649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] MFA Rules not processed for user `a1b2f388eb2447eeae1d6e129f4b3004`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:30.015926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:30.024155 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:30.090083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 935/1875] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:30.101073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:30.102776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:30.135846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:30.162339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45ee75-4f6f-4cb0-81f6-fd6987871102 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:30.166028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:30.166672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:30.166961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:30.167238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:30.177114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:30.178535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9b518-b845-4b49-b00f-04213d2a40b6 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:30.188047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 941/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:30.236349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:30.237905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:30.249917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777aba8-9b0c-4816-8f60-29ee558cd688 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:30.253468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:30.254100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:30.254377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:30.254667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:30.320173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:30.321614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1f5b6-e2e0-4f32-8863-889969f3eaf7 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:30.331290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 936/1877] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:34.662540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:34.663059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:34.663526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:34.665013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 942/1878] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:34.670246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:34.670720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:34.671022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:34.707797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:34.709075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:34.789170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 937/1879] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:34.807963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:34.809781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:34.828896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d26305-2197-4d30-8d9c-402bbbc109bd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:34.834733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:34.835389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:34.835672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:34.835979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:34.845549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:34.847130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44517d0-4d80-4970-85a0-2f8830f9dc23 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:34.857955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 943/1880] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:10:44.778572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:44.853411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=19 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:49.147907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:49.211330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09226b9c-abb9-4bdd-aedb-3ca51afb0eb0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:49.216022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:49.216897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:49.217177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:49.217454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] PATH_INFO: `/v3/users/907ffd7570ec4905a49458b57c4013eb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:49.218645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=907ffd7570ec4905a49458b57c4013eb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:49.221143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:49.275319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907ffd7570ec4905a49458b57c4013eb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.283149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907ffd7570ec4905a49458b57c4013eb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.283859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907ffd7570ec4905a49458b57c4013eb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.290821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907ffd7570ec4905a49458b57c4013eb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.302759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907ffd7570ec4905a49458b57c4013eb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.308973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 938/1881] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:49 2022] DELETE /identity/v3/users/907ffd7570ec4905a49458b57c4013eb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:49.313582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:49.314054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:49.314143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:49.332313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:49.333522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:49.390603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 944/1882] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:49.400717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:49.402100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:49.458105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a675723-df71-40cc-bb7d-67630d1ce3aa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:49.461733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:49.462377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:49.462657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:49.462930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:49.473785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:49.475218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:49.484930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 939/1883] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:49.768357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:49.769831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:49.783665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65aa4-e7d2-4092-85aa-72cb767ff277 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:49.789734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:49.790613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:49.790999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:49.791292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] PATH_INFO: `/v3/projects/d8169b97858b4114b01a9eaf8ac49b03` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:49.793058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8169b97858b4114b01a9eaf8ac49b03)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:49.811358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:49.863315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8169b97858b4114b01a9eaf8ac49b03', 'request_id': 'req-01c89f21-e756-4eed-bb01-0157341dd9b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.872567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8169b97858b4114b01a9eaf8ac49b03', 'request_id': 'req-01c89f21-e756-4eed-bb01-0157341dd9b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.883096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8169b97858b4114b01a9eaf8ac49b03', 'request_id': 'req-01c89f21-e756-4eed-bb01-0157341dd9b4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.895970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] The token cache is being invalidate because project d8169b97858b4114b01a9eaf8ac49b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:49.896409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.897162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:49.899174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 945/1884] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:49 2022] DELETE /identity/v3/projects/d8169b97858b4114b01a9eaf8ac49b03 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:49.902932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:49.916133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da5e9a-0810-47d3-9db1-18f51a5a0bde service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:49.933634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:49.987997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:49.988970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:49.989363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:49.989781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] PATH_INFO: `/v3/users/f6222598288441eaa14f22c2b16b20c0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:49.991088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6222598288441eaa14f22c2b16b20c0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:49.993168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:50.040962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6222598288441eaa14f22c2b16b20c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.048673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6222598288441eaa14f22c2b16b20c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.049291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6222598288441eaa14f22c2b16b20c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.056140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6222598288441eaa14f22c2b16b20c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.068326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6222598288441eaa14f22c2b16b20c0'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.074135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 940/1885] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:49 2022] DELETE /identity/v3/users/f6222598288441eaa14f22c2b16b20c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:50.391515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:50.392976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:50.406259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c89f21-e756-4eed-bb01-0157341dd9b4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:50.462711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:50.463574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:50.463889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:50.464171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] PATH_INFO: `/v3/projects/0582402e455d42af9f943c586eb8ecaa` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:50.465349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0582402e455d42af9f943c586eb8ecaa)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:50.467245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:50.496448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:50.513934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0582402e455d42af9f943c586eb8ecaa', 'request_id': 'req-805b4aa7-2369-427b-8691-4d9b03b2de99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.521213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0582402e455d42af9f943c586eb8ecaa', 'request_id': 'req-805b4aa7-2369-427b-8691-4d9b03b2de99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.527640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0582402e455d42af9f943c586eb8ecaa', 'request_id': 'req-805b4aa7-2369-427b-8691-4d9b03b2de99'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.537781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] The token cache is being invalidate because project 0582402e455d42af9f943c586eb8ecaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:50.538064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.538685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.540233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 946/1886] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:50 2022] DELETE /identity/v3/projects/0582402e455d42af9f943c586eb8ecaa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:50.544234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:50.545762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:50.558594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901aae5f-1a46-4bd1-ae5f-d5471fc3fbd7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:50.621781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:50.622690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:50.622976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:50.623249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] PATH_INFO: `/v3/users/a1b2f388eb2447eeae1d6e129f4b3004` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:50.624457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b2f388eb2447eeae1d6e129f4b3004)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:50.626982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:50.672800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:50.675485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b2f388eb2447eeae1d6e129f4b3004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.684228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b2f388eb2447eeae1d6e129f4b3004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.685379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b2f388eb2447eeae1d6e129f4b3004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.693538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b2f388eb2447eeae1d6e129f4b3004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.706441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-05f01e35-3bc7-4149-95f6-338e2f45a85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b2f388eb2447eeae1d6e129f4b3004'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:50.712471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 941/1887] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:10:50 2022] DELETE /identity/v3/users/a1b2f388eb2447eeae1d6e129f4b3004 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:51.093091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.094968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:51.108078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4aa7-2369-427b-8691-4d9b03b2de99 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.194987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.195898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.196181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.196471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] PATH_INFO: `/v3/projects/5fbe668b5e494fa3bee1a22090c5635c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.197631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbe668b5e494fa3bee1a22090c5635c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.199553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.247575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbe668b5e494fa3bee1a22090c5635c', 'request_id': 'req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:51.255447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbe668b5e494fa3bee1a22090c5635c', 'request_id': 'req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:51.261537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbe668b5e494fa3bee1a22090c5635c', 'request_id': 'req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:51.272905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] The token cache is being invalidate because project 5fbe668b5e494fa3bee1a22090c5635c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:10:51.273190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:51.273807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2f23c8ab-ebe0-465a-9e9f-d22f01c41725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:10:51.275326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 947/1888] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:10:51 2022] DELETE /identity/v3/projects/5fbe668b5e494fa3bee1a22090c5635c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:51.281212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.281509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.281784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.299537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:51.300706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:51.367059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 942/1889] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:51.375750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.376127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.376407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.398727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:51.398727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:51.405908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 948/1890] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:51.410097 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.419630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ac302-1574-4012-a58d-38c1e6227435 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.424802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.425466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.425748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.426022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.426751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:10:51.427614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.428755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.441641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 943/1891] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:10:51.446156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.456212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0131db-f0ed-4c3d-bf28-5ca6ee4fb8c2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.460791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.461472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.461750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.462022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.462702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.464615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.493014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 949/1892] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:10:51 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:51.494462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.505219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435475b-37f4-42cd-84b1-930a73b8e2c0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.560148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.560827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.561105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.561479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.562162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.564698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.585302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 944/1893] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:10:51 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:10:51.589460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.601147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd07d-8cc8-4ada-a2c9-e2c49c015682 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.606038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.606706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.606990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.607270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.608037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.610158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.620835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 950/1894] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:51.625086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.635858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee3d54-a0bb-47c1-90e0-bfa39a18541d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.640543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.641212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.641495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.641774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.642497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.644149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9065ec3-e8f3-4fbb-8793-13bee9f9fc8c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.659137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 945/1895] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:10:51.660517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.666881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:51.670804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ee968-d19f-4035-941d-de2c955ff1e1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.677525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.678962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.679525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.680024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] PATH_INFO: `/v3/projects/a789da2be8594db499e918599b02e7ee/users/3838f76ab8ef4d74b4fe6115d68a23be/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.696460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a789da2be8594db499e918599b02e7ee, user_id=3838f76ab8ef4d74b4fe6115d68a23be, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.699090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.712214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 951/1896] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:10:51 2022] PUT /identity/v3/projects/a789da2be8594db499e918599b02e7ee/users/3838f76ab8ef4d74b4fe6115d68a23be/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:10:51.723478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2dd6-6752-4c4d-b666-8bd376296aa6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.723766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2dd6-6752-4c4d-b666-8bd376296aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.724535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2dd6-6752-4c4d-b666-8bd376296aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.758565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d46b2dd6-6752-4c4d-b666-8bd376296aa6 None None] MFA Rules not processed for user `3838f76ab8ef4d74b4fe6115d68a23be`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:51.759787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d46b2dd6-6752-4c4d-b666-8bd376296aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:51.773056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:10:51.834847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 946/1897] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:10:51.847932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:51.850042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:51.911514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bb30-ed6d-4de6-ba13-62ad391843b2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:51.915325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:51.916004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:51.916288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:51.916563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:51.926052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:51.927483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85c2f0-a248-47cc-966c-5e0b2ff4fc83 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:51.936612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 952/1898] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:10:55.536371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:55.537278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:55.537688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:55.539610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 947/1899] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:10:55.552094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:55.552646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:55.552646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:55.587914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:10:55.600199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:55.722039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 953/1900] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:10:55.729597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:10:55.731333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:10:55.755729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a0517-5093-4e5d-875f-e8a535d44793 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:10:55.763869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:10:55.764586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:10:55.764967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:10:55.765344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:10:55.777352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:10:55.782197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75721a-ff4e-40fa-aa47-1aed9b4cdafe service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:10:55.800635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 948/1901] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:05.697528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:05.789541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=26 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:08.997062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:09.155483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51dba8-340f-4edd-a99c-ecab34fc82e4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:09.169119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:09.170302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:09.170587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:09.170882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] PATH_INFO: `/v3/users/3838f76ab8ef4d74b4fe6115d68a23be` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:09.172323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3838f76ab8ef4d74b4fe6115d68a23be)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:09.178601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:09.311285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3838f76ab8ef4d74b4fe6115d68a23be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:09.340121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3838f76ab8ef4d74b4fe6115d68a23be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:09.341232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3838f76ab8ef4d74b4fe6115d68a23be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:09.342007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3838f76ab8ef4d74b4fe6115d68a23be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:09.368767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3838f76ab8ef4d74b4fe6115d68a23be'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:09.409256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 954/1902] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:08 2022] DELETE /identity/v3/users/3838f76ab8ef4d74b4fe6115d68a23be => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:09.413265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:09.414260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:09.414685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:09.440232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:09.441813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:09.517369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 949/1903] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:09.538674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:09.541344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:09.627241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954aa56-7a3f-4b25-886b-bc7013327c3a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:09.632555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:09.634196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:09.635116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:09.635599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:09.653039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:09.654907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ab2dd-3462-41f4-b01e-4d10fa47dd62 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:09.671070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 955/1904] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:10.279530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.285506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:10.300014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ff0c4-5d62-4b18-936b-4a2670854896 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.304708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.306375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.306686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.306927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] PATH_INFO: `/v3/projects/a789da2be8594db499e918599b02e7ee` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.308186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a789da2be8594db499e918599b02e7ee)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.310195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.417414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a789da2be8594db499e918599b02e7ee', 'request_id': 'req-6ec94b71-d9a1-4802-985d-aa3603b8ec89'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:10.430983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a789da2be8594db499e918599b02e7ee', 'request_id': 'req-6ec94b71-d9a1-4802-985d-aa3603b8ec89'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:10.442258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a789da2be8594db499e918599b02e7ee', 'request_id': 'req-6ec94b71-d9a1-4802-985d-aa3603b8ec89'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:10.455502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] The token cache is being invalidate because project a789da2be8594db499e918599b02e7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:10.455902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:10.456805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-6ec94b71-d9a1-4802-985d-aa3603b8ec89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:10.459310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 950/1905] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:10 2022] DELETE /identity/v3/projects/a789da2be8594db499e918599b02e7ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:10.464041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.464869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.465331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.498947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:10.500798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:10.547595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:10.618388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 956/1906] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:10.627168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.627491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.627773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.649065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:10.650461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:10.658373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 951/1907] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:10.664003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.672961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a227d-3caf-47dd-bc7c-62f642bfbed4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.678339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.678994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.679277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.679555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.680321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:10.680627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.682201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.698657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 957/1908] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:11:10.704508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.714767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fba18-13bf-4698-b8d6-0d5aca080042 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.719396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.720079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.720364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.720707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.721929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.723817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.748770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 952/1909] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:10 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:10.753032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.762997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e287e5-0623-4274-8e85-b86741f7062e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.819487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.820231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.820483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.820751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.821595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.823534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.843767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 958/1910] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:10 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:10.848626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.859161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065154-3b07-4686-8831-075d587b1b46 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.864687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.865552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.865838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.866157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.867014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.868736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.879967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 953/1911] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:10.883987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.894281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e936f13-1920-4227-aafa-306cd2fcd6b6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.899000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.899656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.899970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.900315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.901050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.902695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0c3f-f152-4c51-84a5-463d3cd68f70 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.915937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 959/1912] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:10.919193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:10.929927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cb9d8-a648-4fbb-8b0d-1a184dfb555c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:10.934875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:10.935982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.936496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.937456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] PATH_INFO: `/v3/projects/7409a38b1a394331a79981b6b8de859e/users/426e80d9a0b7472bb871a6b4287c7bac/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:10.953764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7409a38b1a394331a79981b6b8de859e, user_id=426e80d9a0b7472bb871a6b4287c7bac, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:10.957473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:10.975948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 954/1913] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:10 2022] PUT /identity/v3/projects/7409a38b1a394331a79981b6b8de859e/users/426e80d9a0b7472bb871a6b4287c7bac/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:10.986773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:10.987106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:10.987501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.017399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] MFA Rules not processed for user `426e80d9a0b7472bb871a6b4287c7bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:11.019293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:11.099473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 960/1914] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:11.100633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.121120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:11.164673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6b5dd-d917-4bb7-895a-4eb70880463f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.169426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.170087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.170393 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.170644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.171339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.173268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.201849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 955/1915] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:11.203267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.214778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0839-063c-4dc0-88b0-3dab85997781 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.230259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:11.282548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.283245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.283540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.284474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.285236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.287478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.309791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 961/1916] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:11.313338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.325358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec4087-ad19-4445-a883-f423eaecbd59 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.332217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.332951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.333662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.333662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.334577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.336386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.370470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 956/1917] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:11.374761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.388086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e7f7-e521-49ed-aa36-ac56d2c4849d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.392904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.394132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.394418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.394698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.395465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.397183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8c544-262c-429d-b445-c6e977ddcd75 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.408700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 962/1918] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:11.412752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.426875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba914b-aaef-4223-a6b7-ab846c68953f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.432615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.433838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.434320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.434868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] PATH_INFO: `/v3/projects/f4c83166ab804c4a95cdec20e9340af7/users/48ed89786aa84def9232ab4bcc4178b1/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.452806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c83166ab804c4a95cdec20e9340af7, user_id=48ed89786aa84def9232ab4bcc4178b1, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.456142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.472690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 957/1919] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:11 2022] PUT /identity/v3/projects/f4c83166ab804c4a95cdec20e9340af7/users/48ed89786aa84def9232ab4bcc4178b1/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:11.483800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.484274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.484498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.512966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] MFA Rules not processed for user `48ed89786aa84def9232ab4bcc4178b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:11.514218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:11.590592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 963/1920] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:11.595029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.666356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ce72b-4200-44b4-903e-7bcdcb3166f2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.672495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.673404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.673763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.674118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.674926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.677073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.700749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.709075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:11.711041 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 958/1921] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:11.715549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.728238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ecb15-fcc8-4142-8e7e-52705927323f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.795709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:11.802544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2ba51-b4d0-4862-911a-b2911cdd2182 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.811172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.811860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.812141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.812424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.813114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.815686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.828217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.829349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.829647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.829925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] PATH_INFO: `/v3/users/fcf810f208a9493ba60370afa5e7b465` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.831543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf810f208a9493ba60370afa5e7b465)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.833633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.839401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 959/1922] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:11.843176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.853691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd11411-3458-4137-82e2-8d6c77789e8e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.858594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.859498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.859867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.860349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.861149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.863353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.867732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:11.875651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 960/1923] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:11.880822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.890443 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf810f208a9493ba60370afa5e7b465'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:11.891061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb2b17-f24f-4d4f-91a6-e36bd93ff045 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:11.896747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:11.897697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.897997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf810f208a9493ba60370afa5e7b465'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:11.898104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.898410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] PATH_INFO: `/v3/projects/96bec514e1ba46189a3bd034106eae64/users/8e69144dfa364c6d80c14bc0c6ac340a/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.898713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf810f208a9493ba60370afa5e7b465'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:11.899338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf810f208a9493ba60370afa5e7b465'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:11.906346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a1d8e8bc-6e14-46a4-973b-39f2f902a3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf810f208a9493ba60370afa5e7b465'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:11.914071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bec514e1ba46189a3bd034106eae64, user_id=8e69144dfa364c6d80c14bc0c6ac340a, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:11.917105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:11.927040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 964/1924] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:11 2022] DELETE /identity/v3/users/fcf810f208a9493ba60370afa5e7b465 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:11.931478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:11.931776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:11.932084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:11.932450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 961/1925] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:11 2022] PUT /identity/v3/projects/96bec514e1ba46189a3bd034106eae64/users/8e69144dfa364c6d80c14bc0c6ac340a/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:11.936189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:11.937964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:11.951977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:11.953582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.021664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a1853-e08a-42b0-9d09-e9853859abd2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.027176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.027974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.028258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.028583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.029609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.031383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.039761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 965/1926] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:12.043865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 962/1927] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:12.047033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.050633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.052410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.059695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e89a6d-f2f5-44b3-93f7-6baac857f3c6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.065980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.067171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.067285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.067569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] PATH_INFO: `/v3/projects/96bec514e1ba46189a3bd034106eae64/users/8e69144dfa364c6d80c14bc0c6ac340a/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.070722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bec514e1ba46189a3bd034106eae64, user_id=8e69144dfa364c6d80c14bc0c6ac340a, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.073563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d450ef-70eb-4ed0-8cc3-6fa7ecd3c70e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.090622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 966/1928] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:12 2022] PUT /identity/v3/projects/96bec514e1ba46189a3bd034106eae64/users/8e69144dfa364c6d80c14bc0c6ac340a/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:12.101602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.102476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.102858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.137970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819ec1-567d-45a3-a29a-9af9b313e8ac admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.153493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] MFA Rules not processed for user `8e69144dfa364c6d80c14bc0c6ac340a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:12.155514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.206889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.207550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.208261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.208555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.223890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:12.247494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 967/1929] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:12.260991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.263411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.286166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:12.289246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.290999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.305366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 963/1930] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:12.334711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14c24-da12-484f-8130-bb594fb11eb4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.338971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.340069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.340069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.340244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.342086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.410393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.411859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.421394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 968/1931] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:11:12.662962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.664731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.687413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94affa2-7b72-42be-a7be-3a3a8725e61d service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.700205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.701094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.701369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.701643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] PATH_INFO: `/v3/projects/6fa052481d7a4a2684095a56a4759525` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.703725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa052481d7a4a2684095a56a4759525)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.707963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.781537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa052481d7a4a2684095a56a4759525', 'request_id': 'req-d1679c08-4f8f-4cef-85ed-e22e088b324c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:12.791253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa052481d7a4a2684095a56a4759525', 'request_id': 'req-d1679c08-4f8f-4cef-85ed-e22e088b324c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:12.820229 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa052481d7a4a2684095a56a4759525', 'request_id': 'req-d1679c08-4f8f-4cef-85ed-e22e088b324c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:12.840721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] The token cache is being invalidate because project 6fa052481d7a4a2684095a56a4759525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:12.841014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:12.841671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:12.843253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 964/1932] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:12 2022] DELETE /identity/v3/projects/6fa052481d7a4a2684095a56a4759525 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:12.847478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.864524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059985b2-56a0-4803-803b-3d01c71c0097 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.949932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.951033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.951336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.951645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:12.951802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] PATH_INFO: `/v3/users/859d0f6784e841e6a9382063f7de127a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.953309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859d0f6784e841e6a9382063f7de127a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.953431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:12.955226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:12.967869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679c08-4f8f-4cef-85ed-e22e088b324c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:12.976501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:12.977586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:12.977887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:12.978168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] PATH_INFO: `/v3/users/2e2d8e7c5d334c05ae06d7ab48e60205` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:12.979569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2d8e7c5d334c05ae06d7ab48e60205)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:12.981761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.013785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859d0f6784e841e6a9382063f7de127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.025760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859d0f6784e841e6a9382063f7de127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.026460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859d0f6784e841e6a9382063f7de127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.027095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859d0f6784e841e6a9382063f7de127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.034262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cf02fbe2-8438-44d3-b76a-e8d6eb0a7121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859d0f6784e841e6a9382063f7de127a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.036769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2d8e7c5d334c05ae06d7ab48e60205'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.041980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:13.044089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2d8e7c5d334c05ae06d7ab48e60205'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.044825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2d8e7c5d334c05ae06d7ab48e60205'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.053037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2d8e7c5d334c05ae06d7ab48e60205'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.055122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 969/1933] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:12 2022] DELETE /identity/v3/users/859d0f6784e841e6a9382063f7de127a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:13.066154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2d8e7c5d334c05ae06d7ab48e60205'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.072568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 965/1934] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:12 2022] DELETE /identity/v3/users/2e2d8e7c5d334c05ae06d7ab48e60205 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:13.078998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.078998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.078998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.097296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:13.098522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.165518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 970/1935] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:13.175224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.176726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.186637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:13.266542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af5d9a-3fd3-497b-8487-879248d0a68a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.270399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.271053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.271331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.271641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.282107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.283613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920941f-10d8-4096-b815-d64bee4338c3 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.294235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 966/1936] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:13.347984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.349492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.365080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdac9e-8ece-43b6-9def-ecdcd4955120 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.370967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.372271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.372647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.373067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] PATH_INFO: `/v3/projects/e0d452221984409bb4b618251e8161a1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.374360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d452221984409bb4b618251e8161a1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.378364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.440733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d452221984409bb4b618251e8161a1', 'request_id': 'req-cda57750-d3c0-40df-9e22-1910ad7dac90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.451096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d452221984409bb4b618251e8161a1', 'request_id': 'req-cda57750-d3c0-40df-9e22-1910ad7dac90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.457812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d452221984409bb4b618251e8161a1', 'request_id': 'req-cda57750-d3c0-40df-9e22-1910ad7dac90'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.468718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] The token cache is being invalidate because project e0d452221984409bb4b618251e8161a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:13.469085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.470004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cda57750-d3c0-40df-9e22-1910ad7dac90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.471787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 971/1937] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:13 2022] DELETE /identity/v3/projects/e0d452221984409bb4b618251e8161a1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:13.476488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.476785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.477063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.497298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:13.498624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.571180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 967/1938] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:13.573186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.573467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.573786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.592660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:13.593861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.605063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 972/1939] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:13.609587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.621007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44155f8-6d4b-472e-8e0b-f9617ea78fa3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.626217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.626881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.627164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.627516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.628272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:13.628589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.630255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.642499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 968/1940] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:11:13.647165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.656772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.657194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840ed3-d226-462d-96a9-605685f58f9d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.659422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.662603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.663342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.663693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.664073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.664838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.667677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.673671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015efd4b-c86c-4443-becf-82c639595339 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.679759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.680878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.681234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.681669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] PATH_INFO: `/v3/projects/ecc70a11224b4bcab1a8ccb9e3db815b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.682958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc70a11224b4bcab1a8ccb9e3db815b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.685004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.699139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 973/1941] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:13.703452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.744370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc70a11224b4bcab1a8ccb9e3db815b', 'request_id': 'req-c8984b0c-1db7-446f-94d7-cd5280a94bd9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.755345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc70a11224b4bcab1a8ccb9e3db815b', 'request_id': 'req-c8984b0c-1db7-446f-94d7-cd5280a94bd9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.764495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc70a11224b4bcab1a8ccb9e3db815b', 'request_id': 'req-c8984b0c-1db7-446f-94d7-cd5280a94bd9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.776383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] The token cache is being invalidate because project ecc70a11224b4bcab1a8ccb9e3db815b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:13.776704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.777469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c8984b0c-1db7-446f-94d7-cd5280a94bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:13.779332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 969/1942] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:13 2022] DELETE /identity/v3/projects/ecc70a11224b4bcab1a8ccb9e3db815b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:13.784831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:13.786971 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1de6-828e-42df-bd88-32a0aa54ec86 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.787267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1de6-828e-42df-bd88-32a0aa54ec86 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.787556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1de6-828e-42df-bd88-32a0aa54ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.814723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539592d9-5752-405a-bd86-ccc14d747083 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.815962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0d0c1de6-828e-42df-bd88-32a0aa54ec86 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:13.817387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0d0c1de6-828e-42df-bd88-32a0aa54ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.860013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:13.910778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.911471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.911754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.912077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.913163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.916195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.941595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 970/1943] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:13.951425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.951718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.952089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.954925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 974/1944] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:13.959311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:13.961278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.984848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:13.985925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53738d-7732-462e-b531-cc0c99941383 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:13.986031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:13.991254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:13.992040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:13.992329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:13.992610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:13.993599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:13.994998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:13.995510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 971/1945] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:14.000427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.007418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 975/1946] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:14.011301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.014095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeededb9-079b-4b1c-af66-e259204c4f32 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.022292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7f5f4-b22c-4c2d-9140-d94201580217 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.023641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.029561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.031054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.031960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.032593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.035237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.035534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.035841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.036565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.036729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:14.036891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.040476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.056382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.059712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 976/1947] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:14.065715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.096060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 972/1948] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:11:14.097687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.100649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8352-d08c-4cb2-a637-3bdfa0e1b9dc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.108947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.109866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.110153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.110434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] PATH_INFO: `/v3/projects/e9370b988b9f49ed806ee6a802211076/users/aede25b266ee4da19d711520e3b09ef9/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.122227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b602-3a0e-45dd-8f01-719c01594d91 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.127404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.128218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.128726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.129123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.129914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.131932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.147129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9370b988b9f49ed806ee6a802211076, user_id=aede25b266ee4da19d711520e3b09ef9, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.153178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.174669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 973/1949] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/projects => generated 391 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:14.183861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 977/1950] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:14 2022] PUT /identity/v3/projects/e9370b988b9f49ed806ee6a802211076/users/aede25b266ee4da19d711520e3b09ef9/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:14.186540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.188829 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:14.210526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.366514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce4d16-0343-4115-aaa8-9727af2eb0ef admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.384228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.385798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.387455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.388742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.397968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:14.462462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76b59-50f9-4f72-8b26-4266adb0b4df admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.533293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:14.554726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.555588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.556130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.556611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.557663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.559565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.559757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.561496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff1d4-b240-4408-87cb-12f6d0b03c7a service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.579654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 974/1951] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:14.582430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.582978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.583529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.585032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 978/1952] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/users => generated 296 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:14.588953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.602550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954f523-6e69-4fe7-9ee8-f246e051e3d7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.608932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.609606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.609894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.610176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.610910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.612637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.626376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 979/1953] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:14.632828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.636579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] MFA Rules not processed for user `aede25b266ee4da19d711520e3b09ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:14.638775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:14.646201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524314c-9bc3-49f3-9917-7f27dbe4789e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.656417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.658309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.658737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.659170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.660237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.662839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.668081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:14.678438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 980/1954] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:14.682156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.693998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e200-8ad9-4dec-bffa-f8d688c504f7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.700230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.701237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.701676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.702026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] PATH_INFO: `/v3/projects/0e703c2f11e74ac9a86b2cc80da29ce9/users/4a29eab1008d469d9ec72321e8ebe9ea/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.733724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 975/1955] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:14.738942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.739668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e703c2f11e74ac9a86b2cc80da29ce9, user_id=4a29eab1008d469d9ec72321e8ebe9ea, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.745889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038579-d6f9-48ab-b703-3098af537f18 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.752222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3456-f421-4f47-8c3d-d1aee2970d20 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.758241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.759120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.759508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.759966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.760745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.762945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:14.771760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 981/1956] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:14 2022] PUT /identity/v3/projects/0e703c2f11e74ac9a86b2cc80da29ce9/users/4a29eab1008d469d9ec72321e8ebe9ea/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:14.782860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.783150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.783436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.798998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 976/1957] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:14.803615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.821483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] MFA Rules not processed for user `4a29eab1008d469d9ec72321e8ebe9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:14.822718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:14.919730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 982/1958] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:14.922630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e686542-61e2-46b2-9b3b-fbdc19a786e1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:14.931633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:14.933325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:14.944809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:14.945741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:14.946163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:14.946602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:14.947377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:14.952917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.003214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 977/1959] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:14 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:15.007318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.022502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dd02d-a76d-4066-b57e-b3462b1042c1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.033708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.035432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.035718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.039575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.040057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8740-4995-4166-9269-22bfe65e6cce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.040522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.044332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.044464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.045060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.045351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.045632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.056587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.058216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.074583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 978/1960] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:15.079252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.094361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 983/1961] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:11:15.096767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740d2f-b0da-45c5-b5d9-27b25bdc72ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.104237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.105415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.106048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.107238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] PATH_INFO: `/v3/projects/b6567b01e6a44f16a98f4e606f583076/users/d32bbe42865740dd9d8d8cf25a587910/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.147509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6567b01e6a44f16a98f4e606f583076, user_id=d32bbe42865740dd9d8d8cf25a587910, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.153723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.188319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 979/1962] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:15 2022] PUT /identity/v3/projects/b6567b01e6a44f16a98f4e606f583076/users/d32bbe42865740dd9d8d8cf25a587910/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:15.189068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.205090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b5d05-c964-4073-b85d-bd1607638f5b service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.249569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:15.350585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.352214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.352788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.353737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.354938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.357086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87751-63cc-4096-aa45-cb13a7942896 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.372481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 984/1963] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:15.377087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.397505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5667fb-00b6-44e0-858a-43e41460cc9b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.402765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.403743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.405779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.405996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] PATH_INFO: `/v3/projects/b6567b01e6a44f16a98f4e606f583076/users/d32bbe42865740dd9d8d8cf25a587910/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.412548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6567b01e6a44f16a98f4e606f583076, user_id=d32bbe42865740dd9d8d8cf25a587910, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.412548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.422982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 980/1964] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:15 2022] PUT /identity/v3/projects/b6567b01e6a44f16a98f4e606f583076/users/d32bbe42865740dd9d8d8cf25a587910/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:15.436457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.436915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.437262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.453379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.472928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] MFA Rules not processed for user `d32bbe42865740dd9d8d8cf25a587910`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:15.475617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:15.510457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:15.524933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cc19d-9452-4c9b-b993-1802cb6a339d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.529712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.530481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.530849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.531541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.535956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:15.566249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 985/1965] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:15.581544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:15.599147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c075d-cf7c-452a-b26a-2b5e1c66e7ed None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:15.603057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:15.603727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:15.604094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:15.604308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:15.614127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.615554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.631924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:15.633488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:15.634366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 986/1966] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:15.646725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 981/1967] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:11:16.023098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:16.032183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f011-eff7-43ac-9d5c-ddde26734868 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:16.037570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd32bbe42865740dd9d8d8cf25a587910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6567b01e6a44f16a98f4e606f583076', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:16.038551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.039000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.039463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:16.040641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:16.040991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:16.043256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:16.055062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 987/1968] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:11:16.059234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:16.069922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ea2c-b14a-4564-bee2-fa111130cd8f service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:16.074372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd32bbe42865740dd9d8d8cf25a587910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6567b01e6a44f16a98f4e606f583076', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:16.075023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.075306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.075580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:16.076297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:16.078196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:16.105620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 982/1969] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:16 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:16.109981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:16.120193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641fac-830b-4fb7-a514-82281a91ec91 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:16.181680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd32bbe42865740dd9d8d8cf25a587910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6567b01e6a44f16a98f4e606f583076', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:16.182354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.182670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.182937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:16.183672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:16.184021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:16.185656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:16.200516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 988/1970] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:11:16.242637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:16.261394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d08609-20c6-4e7f-a24d-9a212ba31922 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:16.266197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd32bbe42865740dd9d8d8cf25a587910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6567b01e6a44f16a98f4e606f583076', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:16.267069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.267419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.267804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] PATH_INFO: `/v3/projects/680d5c97d1be4b7bbdfeb80094c53df3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:16.269135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=680d5c97d1be4b7bbdfeb80094c53df3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:16.271122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:16.324429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680d5c97d1be4b7bbdfeb80094c53df3', 'request_id': 'req-a1764084-c78c-4a83-bd87-0db63e051613'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.333223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680d5c97d1be4b7bbdfeb80094c53df3', 'request_id': 'req-a1764084-c78c-4a83-bd87-0db63e051613'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.343735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680d5c97d1be4b7bbdfeb80094c53df3', 'request_id': 'req-a1764084-c78c-4a83-bd87-0db63e051613'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.361167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] The token cache is being invalidate because project 680d5c97d1be4b7bbdfeb80094c53df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:16.361584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.362819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a1764084-c78c-4a83-bd87-0db63e051613 tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.364616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 983/1971] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:16 2022] DELETE /identity/v3/projects/680d5c97d1be4b7bbdfeb80094c53df3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:16.617959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:16.619764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:16.633660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:16.703578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8174bb-3ca1-4e16-b681-7237e69823cb tempest-VolumeQuotaClassesTest-482483506 tempest-VolumeQuotaClassesTest-482483506-project-admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:16.812557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:16.813613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.813901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.814182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] PATH_INFO: `/v3/users/aede25b266ee4da19d711520e3b09ef9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:16.815498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aede25b266ee4da19d711520e3b09ef9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:16.817801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:16.928674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aede25b266ee4da19d711520e3b09ef9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.941851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aede25b266ee4da19d711520e3b09ef9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.942767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aede25b266ee4da19d711520e3b09ef9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.944712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aede25b266ee4da19d711520e3b09ef9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.955094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aede25b266ee4da19d711520e3b09ef9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:16.980733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 989/1972] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:16 2022] DELETE /identity/v3/users/aede25b266ee4da19d711520e3b09ef9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:16.985616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:16.986674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:16.986674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:17.015622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:17.017758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:17.092640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:17.126473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 984/1973] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:17.141901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:17.144716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:17.202230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:17.228461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf25b5-72e1-485f-8890-87ff0795da2d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:17.233448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:17.234541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:17.234997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:17.235442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:17.246209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:17.248160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:17.259218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 990/1974] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:17.662727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:17.664470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:17.676485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcddd7-e1f9-4750-9879-abd402808ba8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:17.681361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:17.682228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:17.682512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:17.682789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] PATH_INFO: `/v3/projects/e9370b988b9f49ed806ee6a802211076` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:17.684165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9370b988b9f49ed806ee6a802211076)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:17.686085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:17.746484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9370b988b9f49ed806ee6a802211076', 'request_id': 'req-f53810d5-0e5b-406b-88ee-79ae43d139c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.754433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9370b988b9f49ed806ee6a802211076', 'request_id': 'req-f53810d5-0e5b-406b-88ee-79ae43d139c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.760792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9370b988b9f49ed806ee6a802211076', 'request_id': 'req-f53810d5-0e5b-406b-88ee-79ae43d139c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.770961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] The token cache is being invalidate because project e9370b988b9f49ed806ee6a802211076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:17.771243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.771917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.773434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 985/1975] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:17 2022] DELETE /identity/v3/projects/e9370b988b9f49ed806ee6a802211076 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:17.777508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:17.787174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdf8c-bcb8-430b-86e9-d5100784fdb5 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:17.843902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:17.844785 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:17.845069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:17.845347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] PATH_INFO: `/v3/users/d32bbe42865740dd9d8d8cf25a587910` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:17.846540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32bbe42865740dd9d8d8cf25a587910)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:17.848487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:17.893324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32bbe42865740dd9d8d8cf25a587910'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.900604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32bbe42865740dd9d8d8cf25a587910'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.901289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32bbe42865740dd9d8d8cf25a587910'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.901885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32bbe42865740dd9d8d8cf25a587910'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.909013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a5a405fb-c1c8-4941-a598-e653e509d7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32bbe42865740dd9d8d8cf25a587910'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:17.926462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 991/1976] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:17 2022] DELETE /identity/v3/users/d32bbe42865740dd9d8d8cf25a587910 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:18.276348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.277887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:18.295516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53810d5-0e5b-406b-88ee-79ae43d139c9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.381009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.381907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.382252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.382535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] PATH_INFO: `/v3/projects/b6567b01e6a44f16a98f4e606f583076` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.383886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6567b01e6a44f16a98f4e606f583076)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.385896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.442072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6567b01e6a44f16a98f4e606f583076', 'request_id': 'req-078bf2ec-f645-4de2-9164-60241c6f579d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:18.452458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6567b01e6a44f16a98f4e606f583076', 'request_id': 'req-078bf2ec-f645-4de2-9164-60241c6f579d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:18.461598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6567b01e6a44f16a98f4e606f583076', 'request_id': 'req-078bf2ec-f645-4de2-9164-60241c6f579d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:18.474052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] The token cache is being invalidate because project b6567b01e6a44f16a98f4e606f583076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:18.474392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:18.480503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-078bf2ec-f645-4de2-9164-60241c6f579d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:18.482630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 986/1977] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:18 2022] DELETE /identity/v3/projects/b6567b01e6a44f16a98f4e606f583076 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:18.487265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.487746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.487852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.506156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:18.507345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:18.560561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:18.573331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 992/1978] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:18.582112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.582554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.583079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.597871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:18.605406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:18.607432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:18.615792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 987/1979] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:18.620040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.631622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd214b-9911-43b5-8187-ed971d37c41b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.636350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.637012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.637296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.637577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.638349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:18.638658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.640271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.652776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 993/1980] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:11:18.656921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.666807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c58028-cbb1-40b5-9c7b-2a2e3d2eefaf None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.671529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.672218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.672506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.672785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.673487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.675400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.701286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 988/1981] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:18 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:18.704644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.715809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96b440-8f7b-4df5-9a01-6ea81b477d38 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.774416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.775089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.775403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.775687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.776440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.778439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.800433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 994/1982] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:18 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:18.804203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.814683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605b1e4-5e3d-498f-bf75-adbae36c7fa1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.819999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.820667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.820950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.821351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.822088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.823687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.840919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 989/1983] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:18.845013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.858102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f147a-285d-46cb-9e01-56aaf856bf30 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.863422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.864193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.864542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.864941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.865801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.867445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f5cfa-aa61-428c-a2af-a88931088622 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.879110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 995/1984] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:18.883273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:18.893827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9090-fab8-4e6e-b520-81e99701f65f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:18.898435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:18.899361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.899646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.899965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] PATH_INFO: `/v3/projects/b75f70ed8513474b8a443ab88439eddc/users/f8c4e8721f034b0ab268789304c7ab31/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.914083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75f70ed8513474b8a443ab88439eddc, user_id=f8c4e8721f034b0ab268789304c7ab31, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:18.916747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:18.929178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 990/1985] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:18 2022] PUT /identity/v3/projects/b75f70ed8513474b8a443ab88439eddc/users/f8c4e8721f034b0ab268789304c7ab31/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:18.939409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:18.939704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:18.940731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:18.966962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] MFA Rules not processed for user `f8c4e8721f034b0ab268789304c7ab31`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:18.968245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:19.030133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 996/1986] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:19.034797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.101690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fb1ba-6045-41d2-b42a-a31dbe5cd163 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.106420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.107083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.107370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.107651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.108400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.110316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.135667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 991/1987] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:19 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:19.140065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.151220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e1174-fecc-4b03-843c-48b61f84ccb1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.197606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:19.208183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.208847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.209127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.209402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.210083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.212002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.230643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 997/1988] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:19 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:19.234700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.246009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec461e5-cfbd-4d58-88cc-421bf3ec4504 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.250932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.251609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.251951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.252228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.253519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.255107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.265602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 992/1989] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:19.269942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.279790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba577-c259-42c6-b87a-23326729a460 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.284494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.285488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.285773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.286068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] PATH_INFO: `/v3/projects/b3a418773cec4275944ba159bace0133/users/709aee4b1c2c436a955a07daeece850c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.301277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a418773cec4275944ba159bace0133, user_id=709aee4b1c2c436a955a07daeece850c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.303984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.317026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 998/1990] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:19 2022] PUT /identity/v3/projects/b3a418773cec4275944ba159bace0133/users/709aee4b1c2c436a955a07daeece850c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:19.320819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.331259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af75ce-9e37-4628-9728-cae4a2d62a89 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.401299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.401973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.402270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.402525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.403267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.404937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35856-873a-437a-8f59-1213dc6747c2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.414748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 993/1991] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:19.418932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.430103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44848-3461-49e9-aabf-3592220b4822 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.435771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.437212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.437493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.437763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] PATH_INFO: `/v3/projects/b3a418773cec4275944ba159bace0133/users/709aee4b1c2c436a955a07daeece850c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.439803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a418773cec4275944ba159bace0133, user_id=709aee4b1c2c436a955a07daeece850c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.443238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.455318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 999/1992] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:19 2022] PUT /identity/v3/projects/b3a418773cec4275944ba159bace0133/users/709aee4b1c2c436a955a07daeece850c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:19.466351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.466666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.466950 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.496528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:19.500106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] MFA Rules not processed for user `709aee4b1c2c436a955a07daeece850c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:19.504525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:19.579924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 994/1993] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:19.591003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.592790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:19.656308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aad02-8c18-4aa0-a667-5f6308506e56 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.660526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.661172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.661456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.661859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.670905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.672365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.682383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1000/1994] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:19.728080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:19.729500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:19.741796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864215a-efca-4108-8cc4-a8ec8a5f3430 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:19.745465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:19.746111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:19.746396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:19.746675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:19.805362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:19.806804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea37fe2-8e7f-4cf7-804b-08839d2f0dc5 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:19.816333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 995/1995] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:29.163644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:29.165243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.234236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c644a-2be6-4535-a2e6-751f2c2cb130 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:29.239317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:29.240232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.240513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.240788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] PATH_INFO: `/v3/users/426e80d9a0b7472bb871a6b4287c7bac` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.241984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426e80d9a0b7472bb871a6b4287c7bac)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:29.243921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:29.302294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426e80d9a0b7472bb871a6b4287c7bac'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.305496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:29.317333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426e80d9a0b7472bb871a6b4287c7bac'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.318120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426e80d9a0b7472bb871a6b4287c7bac'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.319222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426e80d9a0b7472bb871a6b4287c7bac'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.327733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426e80d9a0b7472bb871a6b4287c7bac'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.348113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1001/1996] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:29 2022] DELETE /identity/v3/users/426e80d9a0b7472bb871a6b4287c7bac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:29.352994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.353524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.353755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.373777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:29.375001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.393488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:29.395067 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.448008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 996/1997] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:29.457512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:29.458850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.464557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963f32b-d767-4bac-a592-cbdd614fffe7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:29.471409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:29.473949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.474245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.474527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] PATH_INFO: `/v3/users/f8c4e8721f034b0ab268789304c7ab31` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.475768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c4e8721f034b0ab268789304c7ab31)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:29.477714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:29.507419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:29.523489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc42262-4241-400e-9e7b-05bae0fce12b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:29.526215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c4e8721f034b0ab268789304c7ab31'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.527110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:29.527751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.528059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.528324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.534007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c4e8721f034b0ab268789304c7ab31'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.535218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c4e8721f034b0ab268789304c7ab31'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.535851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c4e8721f034b0ab268789304c7ab31'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.538485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:29.539981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fdb50-2e51-4d5a-9628-85cddbfb6f0b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:29.543006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c4e8721f034b0ab268789304c7ab31'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.549477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 997/1998] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:11:29.562085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1002/1999] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:29 2022] DELETE /identity/v3/users/f8c4e8721f034b0ab268789304c7ab31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:29.566483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.566772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.567046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.583874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:29.585104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.648238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 998/2000] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:29.658079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:29.659475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.716068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:29.726275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffaf81-ee36-454a-8e12-e2975d82637b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:29.730092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:29.730741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.731022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.731292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.740899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:29.742635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:29.752281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1003/2001] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:29.861474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:29.863047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:29.877651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f903-e186-4468-82b9-87d6d2023d65 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:29.885139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:29.886655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:29.886999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:29.887340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] PATH_INFO: `/v3/projects/7409a38b1a394331a79981b6b8de859e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:29.890525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7409a38b1a394331a79981b6b8de859e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:29.893227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:29.962465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7409a38b1a394331a79981b6b8de859e', 'request_id': 'req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.975089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7409a38b1a394331a79981b6b8de859e', 'request_id': 'req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.984753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7409a38b1a394331a79981b6b8de859e', 'request_id': 'req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:29.999006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] The token cache is being invalidate because project 7409a38b1a394331a79981b6b8de859e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:29.999255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.000139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.003920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 999/2002] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:29 2022] DELETE /identity/v3/projects/7409a38b1a394331a79981b6b8de859e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:30.009410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.021456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1df6d7-22bf-43d3-a06a-0956dbfa351f service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.099809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.100796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.101077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.101400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] PATH_INFO: `/v3/users/48ed89786aa84def9232ab4bcc4178b1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.105806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ed89786aa84def9232ab4bcc4178b1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.107931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.149217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.150671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:30.173148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c39e4a-a019-4bb1-bdb5-41cd7647caa2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.195284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.199882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.199882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.199882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] PATH_INFO: `/v3/projects/b75f70ed8513474b8a443ab88439eddc` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.201441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75f70ed8513474b8a443ab88439eddc)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.203671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.210029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ed89786aa84def9232ab4bcc4178b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.224058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ed89786aa84def9232ab4bcc4178b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.225312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ed89786aa84def9232ab4bcc4178b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.228232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ed89786aa84def9232ab4bcc4178b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.238361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ed89786aa84def9232ab4bcc4178b1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.263928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1004/2003] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/users/48ed89786aa84def9232ab4bcc4178b1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:30.289958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75f70ed8513474b8a443ab88439eddc', 'request_id': 'req-abacf26f-fa49-4829-8a93-e4c826e604ed'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.300844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75f70ed8513474b8a443ab88439eddc', 'request_id': 'req-abacf26f-fa49-4829-8a93-e4c826e604ed'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.305313 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:30.310675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75f70ed8513474b8a443ab88439eddc', 'request_id': 'req-abacf26f-fa49-4829-8a93-e4c826e604ed'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.329371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] The token cache is being invalidate because project b75f70ed8513474b8a443ab88439eddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:30.329658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.330448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.332922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1000/2004] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/projects/b75f70ed8513474b8a443ab88439eddc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:30.336690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.338137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:30.428301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc50ff-6eb8-4d7b-a5c5-4142e850eca4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.443247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:30.516629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.517835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.518123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.518502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] PATH_INFO: `/v3/users/709aee4b1c2c436a955a07daeece850c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.519804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=709aee4b1c2c436a955a07daeece850c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.525408 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.579183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709aee4b1c2c436a955a07daeece850c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.592591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709aee4b1c2c436a955a07daeece850c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.593366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709aee4b1c2c436a955a07daeece850c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.594029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709aee4b1c2c436a955a07daeece850c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.601200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709aee4b1c2c436a955a07daeece850c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.618991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1005/2005] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/users/709aee4b1c2c436a955a07daeece850c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:30.661823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.663633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:30.698739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacf26f-fa49-4829-8a93-e4c826e604ed admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.758212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.759081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.759363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.759635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] PATH_INFO: `/v3/projects/f4c83166ab804c4a95cdec20e9340af7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.761064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c83166ab804c4a95cdec20e9340af7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.765355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.824575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c83166ab804c4a95cdec20e9340af7', 'request_id': 'req-300ec0c3-241c-46e3-994e-0cf4b295a23e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.832341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c83166ab804c4a95cdec20e9340af7', 'request_id': 'req-300ec0c3-241c-46e3-994e-0cf4b295a23e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.838826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c83166ab804c4a95cdec20e9340af7', 'request_id': 'req-300ec0c3-241c-46e3-994e-0cf4b295a23e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.850095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] The token cache is being invalidate because project f4c83166ab804c4a95cdec20e9340af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:30.850381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.851020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:30.852616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1001/2006] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/projects/f4c83166ab804c4a95cdec20e9340af7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:30.856474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.857893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:30.872706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe196a5-1456-48db-945c-7c5c29601fad admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.902525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:30.904101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:30.954347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.955335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.955602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.955905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] PATH_INFO: `/v3/users/8e69144dfa364c6d80c14bc0c6ac340a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.957125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e69144dfa364c6d80c14bc0c6ac340a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.959033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.970589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec0c3-241c-46e3-994e-0cf4b295a23e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:30.975885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:30.976741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:30.977022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:30.977296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] PATH_INFO: `/v3/projects/b3a418773cec4275944ba159bace0133` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:30.978471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a418773cec4275944ba159bace0133)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:30.980416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:30.999092 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:31.005366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:31.009305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e69144dfa364c6d80c14bc0c6ac340a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.017877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e69144dfa364c6d80c14bc0c6ac340a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.018546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e69144dfa364c6d80c14bc0c6ac340a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.019206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e69144dfa364c6d80c14bc0c6ac340a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.026175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0cb420f8-769c-4824-9e80-087c3de15e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e69144dfa364c6d80c14bc0c6ac340a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.032237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a418773cec4275944ba159bace0133', 'request_id': 'req-3995c9f5-647d-4bb9-bc29-17c256ca30e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.040206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a418773cec4275944ba159bace0133', 'request_id': 'req-3995c9f5-647d-4bb9-bc29-17c256ca30e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.044888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1006/2007] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/users/8e69144dfa364c6d80c14bc0c6ac340a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:31.046526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a418773cec4275944ba159bace0133', 'request_id': 'req-3995c9f5-647d-4bb9-bc29-17c256ca30e6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.058412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] The token cache is being invalidate because project b3a418773cec4275944ba159bace0133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:31.058747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.059457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-3995c9f5-647d-4bb9-bc29-17c256ca30e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.061222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1002/2008] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:30 2022] DELETE /identity/v3/projects/b3a418773cec4275944ba159bace0133 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:31.065840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.066187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.066464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.088535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:31.089863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.154191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1007/2009] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:31.162836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.163132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.163413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.309813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:31.310801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.334876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1003/2010] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:31.336017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.346121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469799d2-7f0d-44ac-91ce-b72cf3948998 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.351754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.352612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.353078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.353442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.354280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:31.354592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.356235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.371624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1008/2011] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:11:31.377019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.392057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590174ef-4dee-460e-9ac3-86c7fc2eeda2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.399266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.399266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.399266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.399266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.399852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.401958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.418336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.420869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.436346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae99ad5-7ec0-4211-bc1e-f9f768301af5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.439031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1004/2012] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:31.442923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.523931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.524740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.525088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.525372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] PATH_INFO: `/v3/projects/96bec514e1ba46189a3bd034106eae64` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.526827 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bec514e1ba46189a3bd034106eae64)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.529066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.555588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f844d5a-439c-4c36-aeeb-83af4af2f231 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.560722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.561480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.561831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.562175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.563072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.565264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.590253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:31.605396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1005/2013] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:31.606703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bec514e1ba46189a3bd034106eae64', 'request_id': 'req-239bd27e-46bf-4d3c-a35c-294e76ed0720'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.606841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.618513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e3538-641c-444d-89b3-3bced9854634 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.622610 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bec514e1ba46189a3bd034106eae64', 'request_id': 'req-239bd27e-46bf-4d3c-a35c-294e76ed0720'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.633345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bec514e1ba46189a3bd034106eae64', 'request_id': 'req-239bd27e-46bf-4d3c-a35c-294e76ed0720'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.647787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] The token cache is being invalidate because project 96bec514e1ba46189a3bd034106eae64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:31.648108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.649298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-239bd27e-46bf-4d3c-a35c-294e76ed0720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:31.654749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1009/2014] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:31 2022] DELETE /identity/v3/projects/96bec514e1ba46189a3bd034106eae64 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:31.660172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaefef-2acd-4f03-9c1b-9d7c5c43a4a4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.663879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaefef-2acd-4f03-9c1b-9d7c5c43a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.664247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaefef-2acd-4f03-9c1b-9d7c5c43a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.688097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-28eaefef-2acd-4f03-9c1b-9d7c5c43a4a4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:31.689349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-28eaefef-2acd-4f03-9c1b-9d7c5c43a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.692723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.693262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.693409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.693688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.694425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.696169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.700495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1010/2015] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:31.710135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.710664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.712345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.721837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1006/2016] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:31.723183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.725166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.737940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:31.740953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:31.742172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.742563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f6d41-9d77-4aca-b6a1-63871913d340 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.749187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.750086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.750999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.751274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.752103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.756122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1011/2017] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:31.756287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.762744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.772693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1007/2018] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:31.776409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca79de7-cb44-412b-8b4e-f06d143f2083 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.776528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.781366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.782025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.782303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.782574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.783305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:31.783612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.785539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.787474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e0038-1cb0-4f05-8d4b-9792c8226f6a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.792186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.793056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.793333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.793605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] PATH_INFO: `/v3/projects/ea1c19f063434fea97a59bf12ad6baf6/users/cf3b6ba8f85e4310819ff699c5631ba4/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.799855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1012/2019] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:11:31.801969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.808311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1c19f063434fea97a59bf12ad6baf6, user_id=cf3b6ba8f85e4310819ff699c5631ba4, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.810932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf54bf2-33e7-4980-9946-9c2c66b4c63e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.811446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8314a9-d047-437a-9138-629b1664523d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.817085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.817795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.818074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.818390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.819089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.821081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.825810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1008/2020] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:31 2022] PUT /identity/v3/projects/ea1c19f063434fea97a59bf12ad6baf6/users/cf3b6ba8f85e4310819ff699c5631ba4/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:11:31.836498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.836790 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.837068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.853269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1013/2021] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:31.854227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.863487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] MFA Rules not processed for user `cf3b6ba8f85e4310819ff699c5631ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:31.864720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.917230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfe250-9a11-441b-a828-cdc68fcb31f4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.925239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.926456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.926736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.927035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.927724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.929646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.933069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1009/2022] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:11:31.945524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.947088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:31.955109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1014/2023] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:31 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:11:31.959258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:31.970675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aa2d8-abd6-43ba-a0fb-af002d84719a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:31.975504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:31.976208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:31.976489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:31.976766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:31.977786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:31.979383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:31.990023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1015/2024] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:31.994010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:32.004543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7adba-f8b2-4683-9d1d-f72bf164c125 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:32.007331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44764a-79bb-4a4e-ad41-0d4ed44f446a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:32.009279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:32.009918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:32.010205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:32.010485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:32.011158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:32.011285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:32.011800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:32.012133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:32.012406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:32.012787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:32.020770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:32.022188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60759af2-d721-4d8e-904d-522dfa87b60d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:32.023500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1016/2025] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:32.027314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:32.031243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1010/2026] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:11:32.036644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1402b-85cf-48fa-a612-bf2407f4e530 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:32.041469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:32.042336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:32.042680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:32.042956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] PATH_INFO: `/v3/projects/9103c619036a4b259ffa5e8d8359e23e/users/60057c94f86e4255ba92bdd7e3b4bfd7/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:32.057868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9103c619036a4b259ffa5e8d8359e23e, user_id=60057c94f86e4255ba92bdd7e3b4bfd7, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:32.060542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:32.073744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1017/2027] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:32 2022] PUT /identity/v3/projects/9103c619036a4b259ffa5e8d8359e23e/users/60057c94f86e4255ba92bdd7e3b4bfd7/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:32.084834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:32.085261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:32.085650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:32.111845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] MFA Rules not processed for user `60057c94f86e4255ba92bdd7e3b4bfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:32.113611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:32.165771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:32.185926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1011/2028] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:32.199313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:32.201330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:32.233049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:32.262853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7328-fffe-4463-b920-707b9025a7e3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:32.266659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:32.267336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:32.267619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:32.268000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:32.276761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:32.279229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46039d13-c8c1-4736-8ff2-6ec3ea306966 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:32.290955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1018/2029] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:39.031965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:39.033396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:39.105705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535409-8a88-4369-98ed-acd508f4076f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:39.110127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:39.110997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:39.111275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:39.111546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] PATH_INFO: `/v3/users/4a29eab1008d469d9ec72321e8ebe9ea` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:39.112819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a29eab1008d469d9ec72321e8ebe9ea)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:39.114876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:39.164673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a29eab1008d469d9ec72321e8ebe9ea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.172557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a29eab1008d469d9ec72321e8ebe9ea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.173133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a29eab1008d469d9ec72321e8ebe9ea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.180354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a29eab1008d469d9ec72321e8ebe9ea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.192319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a29eab1008d469d9ec72321e8ebe9ea'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.198470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1012/2030] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:39 2022] DELETE /identity/v3/users/4a29eab1008d469d9ec72321e8ebe9ea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:39.202952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:39.203461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:39.203554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:39.221512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:39.222835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:39.283683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1019/2031] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:39.293532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:39.295463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:39.355928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c07186-a977-4a13-8792-9a4826213535 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:39.359562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:39.360246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:39.360528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:39.360799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:39.370607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:39.372564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c84ab-6ca7-419a-a252-d4b480d4d02f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:39.383729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1013/2032] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:39.741804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:39.743406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:39.767017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486c15e-ef9c-4005-8e80-cce5dfef639d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:39.779727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:39.780757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:39.781714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:39.782300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] PATH_INFO: `/v3/projects/0e703c2f11e74ac9a86b2cc80da29ce9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:39.784304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e703c2f11e74ac9a86b2cc80da29ce9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:39.788089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:39.888288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e703c2f11e74ac9a86b2cc80da29ce9', 'request_id': 'req-3e572a97-69af-47ad-b7e6-9105c0ee3024'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.899813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e703c2f11e74ac9a86b2cc80da29ce9', 'request_id': 'req-3e572a97-69af-47ad-b7e6-9105c0ee3024'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.908711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e703c2f11e74ac9a86b2cc80da29ce9', 'request_id': 'req-3e572a97-69af-47ad-b7e6-9105c0ee3024'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.922072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] The token cache is being invalidate because project 0e703c2f11e74ac9a86b2cc80da29ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:11:39.922359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.923476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3e572a97-69af-47ad-b7e6-9105c0ee3024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:39.925192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1020/2033] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:39 2022] DELETE /identity/v3/projects/0e703c2f11e74ac9a86b2cc80da29ce9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:39.930015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:39.930305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:39.930585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:39.950775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:39.952037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:39.963857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:40.030630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1014/2034] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:40.040422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.040713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.041036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.059924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:40.061264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:40.069989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1021/2035] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:40.074412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.086344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92675e-923f-4e4c-bf8b-6add4c538402 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.091013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.091677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.092004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.092476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.093021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:11:40.093359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.095179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.107620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1015/2036] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:11:40.111933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.121493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec086fb-5319-4136-bfa2-d9e6d6940631 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.126540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.127213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.127502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.127778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.129047 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.130982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.158051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1022/2037] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:11:40 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:40.162037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.175890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088e61-8755-4bd2-a7d2-7e53586c319c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.250891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.251611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.251946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.252236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.252945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.255475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.292354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1016/2038] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:11:40 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:11:40.295474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.307669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e449-17ef-47b1-af91-96ee5a240687 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.312811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.313522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.313793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.314073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.314923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.317416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.333028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.333354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1023/2039] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:11:40.343604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82fd5-de8b-44c4-b4ff-88e730f56637 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.349096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.349782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.350068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.350344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.351496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.353204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8f475-35c3-4227-80de-ee071c79ee06 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.367804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1017/2040] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:11:40.368774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.380611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb937657-c47a-4aa1-8bb1-0bd0c0b39d46 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.386132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.387050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.387328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.387609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] PATH_INFO: `/v3/projects/51873c15e1d941adbdbe75e50512cf98/users/f988725a73b24ae4bfb49b2826ecc068/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.399516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:40.404572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51873c15e1d941adbdbe75e50512cf98, user_id=f988725a73b24ae4bfb49b2826ecc068, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.408625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.430676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1024/2041] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:11:40 2022] PUT /identity/v3/projects/51873c15e1d941adbdbe75e50512cf98/users/f988725a73b24ae4bfb49b2826ecc068/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:40.440871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.441733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.442019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.468407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] MFA Rules not processed for user `f988725a73b24ae4bfb49b2826ecc068`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:40.469643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:40.539781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1018/2042] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:40.552152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:40.553866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:40.621221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430ea3-b369-4d23-8d2a-b76e9aac6d21 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:40.625354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:40.626005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:40.626289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:40.626569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:40.635253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:40.636731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec68d24-c6f5-4038-9f99-51243fbcab96 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:40.646898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1025/2043] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:50.536522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:50.642248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:11:59.226964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:59.303347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87e95-dc5c-4615-920e-814653bc7ed6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:59.308590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:59.309551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:59.309792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:59.310108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] PATH_INFO: `/v3/users/f988725a73b24ae4bfb49b2826ecc068` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:59.311479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f988725a73b24ae4bfb49b2826ecc068)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:59.313936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:59.409960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f988725a73b24ae4bfb49b2826ecc068'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:59.419340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f988725a73b24ae4bfb49b2826ecc068'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:59.420338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f988725a73b24ae4bfb49b2826ecc068'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:59.428186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f988725a73b24ae4bfb49b2826ecc068'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:59.441388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f988725a73b24ae4bfb49b2826ecc068'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:11:59.448203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1019/2044] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:11:59 2022] DELETE /identity/v3/users/f988725a73b24ae4bfb49b2826ecc068 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:11:59.452834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:59.453305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:59.453532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:59.475392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:11:59.476646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:59.537016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1026/2045] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:11:59.548587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:59.550559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:59.606698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9583351-baaf-4286-beca-eee098bcdbd0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:59.610293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:59.610936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:59.611219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:59.611494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:59.620454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:59.621878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:11:59.632333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1020/2046] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:11:59.915674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:11:59.917649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:11:59.932049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440d11f-fd24-42fe-9a3c-901809d7b8ae None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:11:59.938862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:11:59.939940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:11:59.940224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:11:59.941228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] PATH_INFO: `/v3/projects/51873c15e1d941adbdbe75e50512cf98` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:11:59.942789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51873c15e1d941adbdbe75e50512cf98)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:11:59.945070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:00.001669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51873c15e1d941adbdbe75e50512cf98', 'request_id': 'req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:00.009317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51873c15e1d941adbdbe75e50512cf98', 'request_id': 'req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:00.015712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51873c15e1d941adbdbe75e50512cf98', 'request_id': 'req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:00.027365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] The token cache is being invalidate because project 51873c15e1d941adbdbe75e50512cf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:00.027659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:00.028378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:00.030123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1027/2047] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:11:59 2022] DELETE /identity/v3/projects/51873c15e1d941adbdbe75e50512cf98 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:09.627482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:10.023364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:30.012797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:30.014299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:30.094486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56cd66-7fef-4a18-809a-3eabe61e139e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:30.147349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:30.148896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.149176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.149448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] PATH_INFO: `/v3/users/ba6701e26058440fa098a6a0e9da7f1a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.150622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6701e26058440fa098a6a0e9da7f1a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:30.152625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:30.196639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6701e26058440fa098a6a0e9da7f1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.203511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6701e26058440fa098a6a0e9da7f1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.204207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6701e26058440fa098a6a0e9da7f1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.211413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6701e26058440fa098a6a0e9da7f1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.222848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-34719877-b096-4515-b381-472a0b7f3e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6701e26058440fa098a6a0e9da7f1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.228590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1021/2048] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:30 2022] DELETE /identity/v3/users/ba6701e26058440fa098a6a0e9da7f1a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:30.469714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:30.471514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:30.536518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07c5f3-8ada-4071-9613-ecc2cc63b6d6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:30.598834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:30.599703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.600017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.600307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] PATH_INFO: `/v3/projects/a0add8dd81ce48dda51cbca71cd875d5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.601506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0add8dd81ce48dda51cbca71cd875d5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:30.603401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:30.649412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0add8dd81ce48dda51cbca71cd875d5', 'request_id': 'req-aa99226d-f397-40b1-b47b-5520022f8e52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.656319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0add8dd81ce48dda51cbca71cd875d5', 'request_id': 'req-aa99226d-f397-40b1-b47b-5520022f8e52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.662400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0add8dd81ce48dda51cbca71cd875d5', 'request_id': 'req-aa99226d-f397-40b1-b47b-5520022f8e52'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.672599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] The token cache is being invalidate because project a0add8dd81ce48dda51cbca71cd875d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:30.672890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.673539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-aa99226d-f397-40b1-b47b-5520022f8e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:30.675066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1028/2049] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:30 2022] DELETE /identity/v3/projects/a0add8dd81ce48dda51cbca71cd875d5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:30.680524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.680813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.681089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.702296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:30.737405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:30.738612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:30.795874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1022/2050] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:30.804012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.804308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.805215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.823195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:30.824442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:30.832356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1029/2051] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:30.836389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:30.847087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee84896-0cd6-4db4-b972-89805d8f27eb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:30.853855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:30.854701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.855008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.855344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.856265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:30.856641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:30.858444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:30.874997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1023/2052] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:12:30.877895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:30.887879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce139a-3375-4eff-9b54-0ea8bf0f0658 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:30.898615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:30.899368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:30.899648 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:30.899960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:30.900685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:30.902705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:30.932038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1030/2053] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:30 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:30.936094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:30.946216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6fb6a-555d-46e3-901e-91287058671e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.002792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.003477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.003759 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.004074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.004782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.006683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.028786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1024/2054] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:30 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:31.032876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.044712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034f389-4930-4f47-b019-f1bc724e590f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.050429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.051032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.051313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.051590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.052362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.054035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.065307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1031/2055] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:31.069339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.080841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da18b33-d7d6-46b7-b8e9-df038dd299ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.085911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.086576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.086855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.087127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.087949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.089538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22685aeb-8479-4e11-a0da-bc117b4fe050 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.099999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1025/2056] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:31.104234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.114101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83b12-40c7-45f4-b6cd-05130622ea1c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.119277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.120188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.120474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.120751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] PATH_INFO: `/v3/projects/9ed07471f9fe449495c9f3916134359b/users/eb7ef467d7284338a35d35b5fb32d0f5/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.122945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:31.138355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed07471f9fe449495c9f3916134359b, user_id=eb7ef467d7284338a35d35b5fb32d0f5, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.141044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.152991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1032/2057] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:31 2022] PUT /identity/v3/projects/9ed07471f9fe449495c9f3916134359b/users/eb7ef467d7284338a35d35b5fb32d0f5/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:31.162701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.162990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.163265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.190904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] MFA Rules not processed for user `eb7ef467d7284338a35d35b5fb32d0f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:31.192158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:31.232147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:31.255405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1026/2058] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:31.260381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.321182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034067-1cbf-463f-86a8-28bcc0c8e492 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.325776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.326420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.326704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.326985 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.327672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.329599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.359213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1033/2059] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:31 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:31.363247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.375176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b991f-c13f-45e5-ad03-97d2ffca314f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.429121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.430290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.430573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.430852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.431541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.433506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.456984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1027/2060] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:31 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:31.461429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.471679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8872-0c86-461e-9e02-4a2c867d30a6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.476844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.477499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.477780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.478056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.478779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.480404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.491654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1034/2061] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:31.496637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.506749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcffc34-1ab7-4eaf-b57e-c1a4984e182c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.511530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.512434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.512717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.512991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] PATH_INFO: `/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212/users/a12bfb748a7141a6ab60dfd8fed355f9/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.528028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6234d03661b4e9f9f0f8a05e35ae212, user_id=a12bfb748a7141a6ab60dfd8fed355f9, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.530672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.544639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1028/2062] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:31 2022] PUT /identity/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212/users/a12bfb748a7141a6ab60dfd8fed355f9/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:31.548661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.559310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4efd-dc3b-4d99-afb0-61330ca03f7d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.620416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.621080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.621445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.621797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.622604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.624806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58975fb3-f8b7-45c4-b6d7-91304bbf871b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.645689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1035/2063] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:31.649564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.660078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d962-9b17-43e4-b59f-6e86fbc0d679 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.665280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.666158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.666445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.666722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] PATH_INFO: `/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212/users/a12bfb748a7141a6ab60dfd8fed355f9/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.668744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6234d03661b4e9f9f0f8a05e35ae212, user_id=a12bfb748a7141a6ab60dfd8fed355f9, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.671361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.681902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1029/2064] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:31 2022] PUT /identity/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212/users/a12bfb748a7141a6ab60dfd8fed355f9/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:31.692896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.693187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.693467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.719027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] MFA Rules not processed for user `a12bfb748a7141a6ab60dfd8fed355f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:31.720255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:31.760957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:31.787876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1036/2065] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:31.799337 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:31.801094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:31.873627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69457d9-2814-40a0-80d9-d8d1614e3330 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:31.877531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:31.878173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:31.878459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:31.878738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:31.887801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:31.889265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7418968-cbf8-4041-a67e-cfba3ed8db51 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:31.899175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1030/2066] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:32.302227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:32.363352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364e80f-c588-42a6-a163-c63ef836829d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:32.368014 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:32.368902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:32.369184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:32.369457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] PATH_INFO: `/v3/users/eb7ef467d7284338a35d35b5fb32d0f5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:32.370714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7ef467d7284338a35d35b5fb32d0f5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:32.372722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:32.423261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7ef467d7284338a35d35b5fb32d0f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:32.430471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7ef467d7284338a35d35b5fb32d0f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:32.431107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7ef467d7284338a35d35b5fb32d0f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:32.431728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7ef467d7284338a35d35b5fb32d0f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:32.438558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7ef467d7284338a35d35b5fb32d0f5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:32.455928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1037/2067] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:32 2022] DELETE /identity/v3/users/eb7ef467d7284338a35d35b5fb32d0f5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:32.460416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:32.460943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:32.461043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:32.478974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:32.480207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:32.495932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:32.542776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1031/2068] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:32.552399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:32.553831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:32.616432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:32.634207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f21c5-fd21-462a-b2cd-e490df423d7f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:32.637885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:32.638522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:32.638807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:32.639081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:32.648093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:32.649565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:32.659853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1038/2069] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:33.016250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.017749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:33.030126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed961bc-c085-4472-9e8b-22096245c8ef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.036736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.037605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.037904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.038175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] PATH_INFO: `/v3/projects/9ed07471f9fe449495c9f3916134359b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.039921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed07471f9fe449495c9f3916134359b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.041941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.090258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed07471f9fe449495c9f3916134359b', 'request_id': 'req-e1920ea4-4838-495c-9912-2dd67560193a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.097397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed07471f9fe449495c9f3916134359b', 'request_id': 'req-e1920ea4-4838-495c-9912-2dd67560193a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.104054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed07471f9fe449495c9f3916134359b', 'request_id': 'req-e1920ea4-4838-495c-9912-2dd67560193a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.114208 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] The token cache is being invalidate because project 9ed07471f9fe449495c9f3916134359b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:33.114604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.115238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.116848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1032/2070] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:33 2022] DELETE /identity/v3/projects/9ed07471f9fe449495c9f3916134359b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:33.121403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.131072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ee03d-c858-4849-872d-6052333492b2 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.185448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.186312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.186596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.186872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] PATH_INFO: `/v3/users/a12bfb748a7141a6ab60dfd8fed355f9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.188071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12bfb748a7141a6ab60dfd8fed355f9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.190019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.233740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12bfb748a7141a6ab60dfd8fed355f9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.241043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12bfb748a7141a6ab60dfd8fed355f9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.241701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12bfb748a7141a6ab60dfd8fed355f9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.242896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12bfb748a7141a6ab60dfd8fed355f9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.249952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7f8791f8-2223-4c0c-9953-257fba79fd66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12bfb748a7141a6ab60dfd8fed355f9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.266805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1039/2071] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:33 2022] DELETE /identity/v3/users/a12bfb748a7141a6ab60dfd8fed355f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:33.537068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.538533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:33.552054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920ea4-4838-495c-9912-2dd67560193a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.609618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.610524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.610805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.611078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] PATH_INFO: `/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.612469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6234d03661b4e9f9f0f8a05e35ae212)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.614381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.658109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:33.659301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6234d03661b4e9f9f0f8a05e35ae212', 'request_id': 'req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.668298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6234d03661b4e9f9f0f8a05e35ae212', 'request_id': 'req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.674428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6234d03661b4e9f9f0f8a05e35ae212', 'request_id': 'req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.684579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] The token cache is being invalidate because project e6234d03661b4e9f9f0f8a05e35ae212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:33.684872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.685507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-64ca628c-b858-4dc1-a8e5-2aea9ca1bc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:33.687025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1033/2072] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:33 2022] DELETE /identity/v3/projects/e6234d03661b4e9f9f0f8a05e35ae212 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:33.691923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.692389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.692487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.710231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:33.712024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:33.766797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:33.776709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1040/2073] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:33.784331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.784623 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.784926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.802746 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:33.803990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:33.811855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1034/2074] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:33.815950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.826279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d57065-1a68-4c38-bcd9-c3266c086553 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.830956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.831598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.831906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.832182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.832937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:33.833241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.834850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.846828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1041/2075] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:12:33.850896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.860026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15193f9c-0e3c-431c-82c1-e5c2791fd731 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.864729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.865373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.865654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.865926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.866605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.868541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.899566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1035/2076] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:33 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:33.900684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:33.910551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bdd7f-cfdf-48c7-8ffa-1f03bc831317 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:33.970651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:33.971322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:33.971599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:33.971900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:33.972597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:33.974497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:33.993703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1042/2077] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:33 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:33.997920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.009077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25dfb-6006-4caf-b5f2-899a01352c67 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.013776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.014433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.014715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.014989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.015705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.017333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.040011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1036/2078] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:34.043979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.054021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ec6b-c225-4322-956f-c89ea9ce87c2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.059183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.059850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.060144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.060423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.061189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.062780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6baff-29e1-4170-b938-1d04bba6d429 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.073347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1043/2079] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:34.077519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.087777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6a56f-66cb-4706-ba35-3079cde71194 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.092562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.093437 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.093721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.093998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] PATH_INFO: `/v3/projects/26390b95e81e4717ab369c91737a4d6a/users/a09e2e65f9464f799d44080eb1dd362b/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.108374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26390b95e81e4717ab369c91737a4d6a, user_id=a09e2e65f9464f799d44080eb1dd362b, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.111025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.124399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1037/2080] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:34 2022] PUT /identity/v3/projects/26390b95e81e4717ab369c91737a4d6a/users/a09e2e65f9464f799d44080eb1dd362b/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:34.135266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.135560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.135864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.161544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] MFA Rules not processed for user `a09e2e65f9464f799d44080eb1dd362b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:34.162984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:34.226317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1044/2081] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:34.230603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.290084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1387c-6804-4c00-b504-473350c0bafb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.294701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.295343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.295624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.295931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.296601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.298479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.323806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1038/2082] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:34 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:34.327919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.338747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79255c8a-14f7-46d6-a2e3-eb322a7ff72d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.387942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:34.395810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.396498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.396778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.397053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.397737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.399684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.419837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1045/2083] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:34 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:34.423796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.434545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3034cf7-fcd0-4870-93d5-4e46734d41b3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.439201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.439876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.440166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.440443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.441176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.442767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.453725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1039/2084] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:34.457634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.467950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d3ba-ac40-49dc-b504-5b5d92906df8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.472795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.473656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.473964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.474236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] PATH_INFO: `/v3/projects/7ebf348aa08945c098d40307c579c61b/users/8a5c489114bf47ab8a741df922112c42/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.489156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebf348aa08945c098d40307c579c61b, user_id=8a5c489114bf47ab8a741df922112c42, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.491811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.505420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1046/2085] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:34 2022] PUT /identity/v3/projects/7ebf348aa08945c098d40307c579c61b/users/8a5c489114bf47ab8a741df922112c42/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:34.509361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.519309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e59b66-1d9d-430e-8126-5946f3947828 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.566650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:34.583621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.584439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.584725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.585000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.585729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.587354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b801f-1996-4c34-afd1-81d250504e8c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.597222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1040/2086] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:34.601903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.612020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be77a-174f-4d3a-a124-3c9c94d52929 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.616559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.618029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.618306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.618581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] PATH_INFO: `/v3/projects/7ebf348aa08945c098d40307c579c61b/users/8a5c489114bf47ab8a741df922112c42/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.620538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebf348aa08945c098d40307c579c61b, user_id=8a5c489114bf47ab8a741df922112c42, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.623148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.633320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1047/2087] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:34 2022] PUT /identity/v3/projects/7ebf348aa08945c098d40307c579c61b/users/8a5c489114bf47ab8a741df922112c42/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:34.644223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.644524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.644804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.671239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] MFA Rules not processed for user `8a5c489114bf47ab8a741df922112c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:34.672481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:34.739000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1041/2088] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:34.750919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.752641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:34.810543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a9c8a-b23e-46d8-a26a-b4b564be0ef1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.814182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.814822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.815105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.815379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.824190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.825607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271574c-1310-45d0-a707-607180f7b58f service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.834873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1048/2089] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:34.862807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:34.926401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3936fd-edd8-4408-ba69-151c1a838358 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:34.931004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:34.931897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:34.932183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:34.932457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] PATH_INFO: `/v3/users/a09e2e65f9464f799d44080eb1dd362b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:34.933640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09e2e65f9464f799d44080eb1dd362b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:34.935548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:34.980144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09e2e65f9464f799d44080eb1dd362b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:34.987106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09e2e65f9464f799d44080eb1dd362b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:34.987736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09e2e65f9464f799d44080eb1dd362b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:34.994606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09e2e65f9464f799d44080eb1dd362b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.000045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:35.008614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09e2e65f9464f799d44080eb1dd362b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.014920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1042/2090] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:34 2022] DELETE /identity/v3/users/a09e2e65f9464f799d44080eb1dd362b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:35.019649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:35.019971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:35.020250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:35.039778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:35.041108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:35.117628 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1049/2091] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:35.129541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:35.130958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:35.189861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707cc4-876f-4263-bc09-9e1b704b7ee2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:35.193638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:35.194288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:35.194572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:35.194853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:35.204826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:35.206293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:35.216248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1043/2092] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:35.486441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:35.487889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:35.500414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361f58-f551-4a8d-87a1-d9faefe5d760 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:35.505233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:35.506101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:35.506380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:35.506655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] PATH_INFO: `/v3/projects/26390b95e81e4717ab369c91737a4d6a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:35.508378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=26390b95e81e4717ab369c91737a4d6a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:35.510274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:35.553736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:35.557371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26390b95e81e4717ab369c91737a4d6a', 'request_id': 'req-b72fa791-37ef-4a60-baf0-9175121cc9bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.564673 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26390b95e81e4717ab369c91737a4d6a', 'request_id': 'req-b72fa791-37ef-4a60-baf0-9175121cc9bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.571518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26390b95e81e4717ab369c91737a4d6a', 'request_id': 'req-b72fa791-37ef-4a60-baf0-9175121cc9bb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.581558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] The token cache is being invalidate because project 26390b95e81e4717ab369c91737a4d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:35.581842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.582462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.584003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1050/2093] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:35 2022] DELETE /identity/v3/projects/26390b95e81e4717ab369c91737a4d6a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:35.587906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:35.602009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd680-bf25-4451-b0fb-298e19d90cf8 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:35.656672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:35.657538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:35.657820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:35.658091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] PATH_INFO: `/v3/users/8a5c489114bf47ab8a741df922112c42` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:35.659264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5c489114bf47ab8a741df922112c42)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:35.661213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:35.705058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5c489114bf47ab8a741df922112c42'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.712148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5c489114bf47ab8a741df922112c42'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.712769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5c489114bf47ab8a741df922112c42'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.719464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5c489114bf47ab8a741df922112c42'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.731087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-bd9557f1-c351-4c2d-a71a-e1075f001ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5c489114bf47ab8a741df922112c42'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:35.736889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1044/2094] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:35 2022] DELETE /identity/v3/users/8a5c489114bf47ab8a741df922112c42 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:36.006030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.007561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:36.020589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa791-37ef-4a60-baf0-9175121cc9bb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.082969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.083764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.084084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.084376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] PATH_INFO: `/v3/projects/7ebf348aa08945c098d40307c579c61b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.085589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebf348aa08945c098d40307c579c61b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.087788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.135168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebf348aa08945c098d40307c579c61b', 'request_id': 'req-63535a1b-661c-4928-b771-77c4b0d455b7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:36.143147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebf348aa08945c098d40307c579c61b', 'request_id': 'req-63535a1b-661c-4928-b771-77c4b0d455b7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:36.149414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebf348aa08945c098d40307c579c61b', 'request_id': 'req-63535a1b-661c-4928-b771-77c4b0d455b7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:36.159754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] The token cache is being invalidate because project 7ebf348aa08945c098d40307c579c61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:36.160094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:36.164334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-63535a1b-661c-4928-b771-77c4b0d455b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:36.165963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1051/2095] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:36 2022] DELETE /identity/v3/projects/7ebf348aa08945c098d40307c579c61b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:36.170968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.171257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.171534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.189290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:36.190477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:36.194833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:36.252769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1045/2096] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:36.260365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.260657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.260939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.279023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:36.280271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:36.288379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1052/2097] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:36.293180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.302966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3686f4-db19-443b-8010-9e71f20baa23 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.308207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.308864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.309148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.309422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.310235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:36.310714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.312854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.326541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1046/2098] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:12:36.330863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.341052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df89246-ef42-40bc-9756-889dc06ad307 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.345875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.346522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.346806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.347082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.347779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.349700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.378531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1053/2099] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:36.382708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.392668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270d31f-7cc2-4c09-8968-1d86cb3e3133 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.448004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.448674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.448956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.449234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.449918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.451881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.471481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1047/2100] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:36.475550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.486352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00bc2-5064-4ac7-ae94-89eae21f9925 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.490945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.491595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.491934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.492220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.492972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.494597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.505144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1054/2101] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:36.508769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.518626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa98f-f5d3-4fea-bc9c-4c3bb13dc46f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.523769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.524450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.524735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.525019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.525757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.527348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3a0a3-a03d-47d9-a2c0-8ed00b771447 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.537145 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1048/2102] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:36.541640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.551464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376e581-f703-4868-a1bf-88e5c2587f48 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.557085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.558218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.558505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.558982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] PATH_INFO: `/v3/projects/cafd6c9d59f14aca956a3cc42613cf52/users/690b4fbdc9db430e85a16ff30d6e8bdf/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.575226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafd6c9d59f14aca956a3cc42613cf52, user_id=690b4fbdc9db430e85a16ff30d6e8bdf, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.577883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.586899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:36.592097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1055/2103] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:36 2022] PUT /identity/v3/projects/cafd6c9d59f14aca956a3cc42613cf52/users/690b4fbdc9db430e85a16ff30d6e8bdf/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:36.604831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.605279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.605389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.635909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] MFA Rules not processed for user `690b4fbdc9db430e85a16ff30d6e8bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:36.637101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:36.699698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1049/2104] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:36.704125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.764226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17f3b-ae89-4b03-88d0-58aed91d0dc6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.768743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.769376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.769655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.769927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.770602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.772520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.797287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1056/2105] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:36.801527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.812092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fb3f-14b1-4cd4-9ee0-3cb9ec475009 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.813569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:36.869944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.870844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.870941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.871180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.871903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.874451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.895740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1050/2106] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:36 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:36.900304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.910316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ef34b-ca57-4c5e-999f-b75205832bfd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.914976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.915618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.915927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.916204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.916921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.918488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.928845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1057/2107] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:36.932684 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.942694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97fd61-40f5-4784-a418-f889a9326ac4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.948243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.948893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.949173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.949445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.950163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.951798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb99ebd-bc3d-4ce4-b486-5ee76948399c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:36.962311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1051/2108] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:36.966464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:36.976386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39befe9d-e744-4cd3-9177-41e8cbe27ced admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:36.980864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:36.981723 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:36.982002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:36.982300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] PATH_INFO: `/v3/projects/811141ea06ac430eba3322c40f688522/users/5125aec3bc774477a2cc2999ddf2d2ad/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:36.996536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811141ea06ac430eba3322c40f688522, user_id=5125aec3bc774477a2cc2999ddf2d2ad, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:36.999412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.013346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1058/2109] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:36 2022] PUT /identity/v3/projects/811141ea06ac430eba3322c40f688522/users/5125aec3bc774477a2cc2999ddf2d2ad/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:37.023940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.024232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.024506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.050110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] MFA Rules not processed for user `5125aec3bc774477a2cc2999ddf2d2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:37.051335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:37.117456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1052/2110] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:37.121875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.182609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3f48f-661f-4296-8fa4-0e04eaa52510 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.187366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.188061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.188344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.188625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.189390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.191259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.217232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1059/2111] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:37 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:37.221267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.231897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef695f-9718-41e5-902e-75d3f0e18adc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.288326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.289022 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.289303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.289579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.290268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.292238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.310643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1053/2112] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:37 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:37.314720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.325406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34934c8e-8d01-4a75-857c-62a5961c233d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.330019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.330667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.330955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.331227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.331978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.333595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.344922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1060/2113] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:37.348887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.353964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:37.360079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a13a6f-5f3e-4fd3-9e20-0996a707f7ef admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.365137 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.367392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.367731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.367992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] PATH_INFO: `/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9/users/cabbd24a42004c258350a443d5e1c2fd/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.384242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cdb6f7290d42aea0d495a7f7549fb9, user_id=cabbd24a42004c258350a443d5e1c2fd, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.387415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.403509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1054/2114] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:37 2022] PUT /identity/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9/users/cabbd24a42004c258350a443d5e1c2fd/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:37.407611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.417685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e22ae-cfad-4c2b-842b-14284393ffb1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.439338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:37.480419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.481168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.481457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.481735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.482477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.484093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313abaa-6322-41ad-8a22-98d5f624b621 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.494834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1061/2115] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:37.499403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.509942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9dcc0-abea-4775-8cfb-ed8f53423570 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.515002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.516011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.516363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.516711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] PATH_INFO: `/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9/users/cabbd24a42004c258350a443d5e1c2fd/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.518852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cdb6f7290d42aea0d495a7f7549fb9, user_id=cabbd24a42004c258350a443d5e1c2fd, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.521711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.533589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1055/2116] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:37 2022] PUT /identity/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9/users/cabbd24a42004c258350a443d5e1c2fd/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:37.544101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.544392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.544666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.570772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] MFA Rules not processed for user `cabbd24a42004c258350a443d5e1c2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:37.571999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:37.637629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1062/2117] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:37.647976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:37.649750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:37.707110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd801c61-503b-48bc-94a4-d648ecbd26e5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:37.710775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:37.711406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:37.711686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:37.711995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:37.720740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:37.722161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:37.731805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1056/2118] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:38.210018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:38.220580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bab73-1194-4f1e-b592-5e923a9ba67e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:38.224184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:38.224822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:38.225107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:38.225382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:38.282118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:38.283531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380269a-18c5-4522-a8ff-1c067f0ac030 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:38.292557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1063/2119] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:42.809677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:42.811094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:42.874804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5769512-60f2-4dac-99e6-0a74859bc75d service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:42.880540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:42.881406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:42.881686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:42.881956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] PATH_INFO: `/v3/users/60057c94f86e4255ba92bdd7e3b4bfd7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:42.883701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60057c94f86e4255ba92bdd7e3b4bfd7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:42.885673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:42.933421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60057c94f86e4255ba92bdd7e3b4bfd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:42.941322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60057c94f86e4255ba92bdd7e3b4bfd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:42.942012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60057c94f86e4255ba92bdd7e3b4bfd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:42.949660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60057c94f86e4255ba92bdd7e3b4bfd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:42.955037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:42.964837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60057c94f86e4255ba92bdd7e3b4bfd7'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:42.971692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1057/2120] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:42 2022] DELETE /identity/v3/users/60057c94f86e4255ba92bdd7e3b4bfd7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:42.976211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:42.976690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:42.976906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:42.993734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:42.994947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.038831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:43.058829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1064/2121] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:43.068227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.069716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.141076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac45b3-751b-43a0-ac33-2004c150b4bb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.145228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.145892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.146327 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.146635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.156046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.157640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.168787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1058/2122] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:43.405461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.407434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.459969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.462094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.487169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8cb0-04d9-413f-a41f-82cb53f0178e service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.494356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.495294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.495707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.496087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] PATH_INFO: `/v3/projects/9103c619036a4b259ffa5e8d8359e23e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.497303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9103c619036a4b259ffa5e8d8359e23e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.499477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.505109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c84956-d656-4ec4-9f80-bff493033f9f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.508792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.509435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.509718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.509996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.511764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.550402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9103c619036a4b259ffa5e8d8359e23e', 'request_id': 'req-7635728a-8b6c-4d6e-b4a0-38343332f7c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:43.559042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9103c619036a4b259ffa5e8d8359e23e', 'request_id': 'req-7635728a-8b6c-4d6e-b4a0-38343332f7c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:43.565493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9103c619036a4b259ffa5e8d8359e23e', 'request_id': 'req-7635728a-8b6c-4d6e-b4a0-38343332f7c9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:43.572481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.573956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26217570-4027-40a4-80cf-e5827d1950db service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.576647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] The token cache is being invalidate because project 9103c619036a4b259ffa5e8d8359e23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:43.577054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:43.577783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7635728a-8b6c-4d6e-b4a0-38343332f7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:43.579414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1059/2123] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:43 2022] DELETE /identity/v3/projects/9103c619036a4b259ffa5e8d8359e23e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:43.583435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1065/2124] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:43.584749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.585036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.585317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.605249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:43.606552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.676121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1060/2125] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:43.684800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.685116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.685398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.704761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:43.705959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:43.714407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1066/2126] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:43.718485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.728494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b108a-9dfb-4349-a3b8-599332070246 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.733076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.733725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.734004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.734286 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.735023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:43.735331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.736961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.752629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:43.760169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1061/2127] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:12:43.761215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.770329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8ab25-26b1-4ee2-9f16-92478f229d92 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.775326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.776048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.776334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.776617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.777320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.779225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.807911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1067/2128] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:43 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:43.812277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.822942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e536ed-08eb-458c-9e85-1c40e3b8e5a8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.883463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.884167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.884450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.884725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.885421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.887339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.908406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1062/2129] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:43 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:43.912878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.925418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52651-605e-4a7b-8bb6-26c87c57c205 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.930808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.931540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.931910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.932269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.933106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.934838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.945140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1068/2130] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:43.949671 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.961441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dd53e-3d73-4d16-a407-87513cb09c9b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:43.966464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:43.967122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:43.967412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:43.967692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:43.968480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:43.970151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35b94-c48e-4141-8dfb-af46c1bf58c6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:43.981359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1063/2131] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:43.985533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:43.996057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801e34-6534-438a-9a3d-2c1a72c12c8f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:44.002051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:44.002942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:44.003231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:44.003535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] PATH_INFO: `/v3/projects/54af18468cec4f8ba59e9a7e134e3705/users/f1aae8526b6d4b0eb0bff5b3eaa80273/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:44.018718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=54af18468cec4f8ba59e9a7e134e3705, user_id=f1aae8526b6d4b0eb0bff5b3eaa80273, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:44.021593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:44.035268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1069/2132] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:43 2022] PUT /identity/v3/projects/54af18468cec4f8ba59e9a7e134e3705/users/f1aae8526b6d4b0eb0bff5b3eaa80273/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:44.108186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:44.108186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:44.109151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:44.136705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] MFA Rules not processed for user `f1aae8526b6d4b0eb0bff5b3eaa80273`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:44.137913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:44.204058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1064/2133] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:44.215669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:44.217556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:44.237269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:44.284674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa038-8bc1-492d-a79f-6227050ad3ee admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:44.288318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:44.288980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:44.289257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:44.289529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:44.297630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:44.299022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42040bf4-9ed8-4fa3-9675-a450566baecf service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:44.307871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1070/2134] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:45.675579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:45.677150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:45.757336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3030d-b24b-4405-a47c-325382dde92c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:45.763111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:45.764404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:45.764794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:45.765360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] PATH_INFO: `/v3/users/690b4fbdc9db430e85a16ff30d6e8bdf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:45.766613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=690b4fbdc9db430e85a16ff30d6e8bdf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:45.775702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:45.791962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:45.846737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690b4fbdc9db430e85a16ff30d6e8bdf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:45.853091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690b4fbdc9db430e85a16ff30d6e8bdf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:45.853972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690b4fbdc9db430e85a16ff30d6e8bdf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:45.863054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690b4fbdc9db430e85a16ff30d6e8bdf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:45.880212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690b4fbdc9db430e85a16ff30d6e8bdf'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:45.891890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1065/2135] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:45 2022] DELETE /identity/v3/users/690b4fbdc9db430e85a16ff30d6e8bdf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:45.893588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:45.894063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:45.894167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:45.914601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:45.915846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:46.001970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1071/2136] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:46.012528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:46.013983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:46.140330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39333b-336a-4a90-9ae8-50333ca8d8ea admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:46.144886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:46.145777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:46.146133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:46.146481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:46.159187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:46.161822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:46.184583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1066/2137] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:46.600926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:46.603065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:46.614928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3235c9-038d-4a29-b2c3-418aebd693ea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:46.620199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:46.621063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:46.621349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:46.621629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] PATH_INFO: `/v3/projects/cafd6c9d59f14aca956a3cc42613cf52` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:46.622893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafd6c9d59f14aca956a3cc42613cf52)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:46.625152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:46.692183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafd6c9d59f14aca956a3cc42613cf52', 'request_id': 'req-f696abeb-1627-4c9b-a4fc-28158281b4ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.700370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafd6c9d59f14aca956a3cc42613cf52', 'request_id': 'req-f696abeb-1627-4c9b-a4fc-28158281b4ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.706843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafd6c9d59f14aca956a3cc42613cf52', 'request_id': 'req-f696abeb-1627-4c9b-a4fc-28158281b4ed'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.717470 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] The token cache is being invalidate because project cafd6c9d59f14aca956a3cc42613cf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:46.717765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.718422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.720059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1072/2138] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:46 2022] DELETE /identity/v3/projects/cafd6c9d59f14aca956a3cc42613cf52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:46.724163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:46.734853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42eb6b-97c4-4828-80eb-581e3a0ae854 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:46.792102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:46.792991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:46.793271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:46.793544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] PATH_INFO: `/v3/users/5125aec3bc774477a2cc2999ddf2d2ad` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:46.794740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5125aec3bc774477a2cc2999ddf2d2ad)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:46.796706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:46.837215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:46.850296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5125aec3bc774477a2cc2999ddf2d2ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.857545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5125aec3bc774477a2cc2999ddf2d2ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.858176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5125aec3bc774477a2cc2999ddf2d2ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.865019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5125aec3bc774477a2cc2999ddf2d2ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.877619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5125aec3bc774477a2cc2999ddf2d2ad'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:46.883969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1067/2139] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:46 2022] DELETE /identity/v3/users/5125aec3bc774477a2cc2999ddf2d2ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:47.173994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:47.173994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:47.197915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696abeb-1627-4c9b-a4fc-28158281b4ed admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:47.255434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:47.275405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:47.276428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:47.276713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:47.276992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] PATH_INFO: `/v3/projects/811141ea06ac430eba3322c40f688522` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:47.278184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811141ea06ac430eba3322c40f688522)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:47.280120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:47.336749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811141ea06ac430eba3322c40f688522', 'request_id': 'req-78a9812c-39af-4243-b6c9-934fe8dc1457'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.345449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811141ea06ac430eba3322c40f688522', 'request_id': 'req-78a9812c-39af-4243-b6c9-934fe8dc1457'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.352364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811141ea06ac430eba3322c40f688522', 'request_id': 'req-78a9812c-39af-4243-b6c9-934fe8dc1457'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.364467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] The token cache is being invalidate because project 811141ea06ac430eba3322c40f688522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:47.364869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.365618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.367729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1073/2140] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:47 2022] DELETE /identity/v3/projects/811141ea06ac430eba3322c40f688522 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:47.371975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:47.373468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:47.391685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510dc63-dddc-4aab-86d8-32aafdc9f872 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:47.462589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:47.463414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:47.463692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:47.464079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] PATH_INFO: `/v3/users/cabbd24a42004c258350a443d5e1c2fd` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:47.465287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabbd24a42004c258350a443d5e1c2fd)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:47.467251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:47.519309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabbd24a42004c258350a443d5e1c2fd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.528970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabbd24a42004c258350a443d5e1c2fd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.529675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabbd24a42004c258350a443d5e1c2fd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.539797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabbd24a42004c258350a443d5e1c2fd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.558830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-75190aa2-ef33-4a6e-9fe7-d4c006d7d1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabbd24a42004c258350a443d5e1c2fd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.569075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1068/2141] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:47 2022] DELETE /identity/v3/users/cabbd24a42004c258350a443d5e1c2fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:47.839701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:47.841203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:47.853893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9812c-39af-4243-b6c9-934fe8dc1457 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:47.912242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:47.913113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:47.913395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:47.913674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] PATH_INFO: `/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:47.915327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cdb6f7290d42aea0d495a7f7549fb9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:47.917265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:47.962487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cdb6f7290d42aea0d495a7f7549fb9', 'request_id': 'req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.969304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cdb6f7290d42aea0d495a7f7549fb9', 'request_id': 'req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.975267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cdb6f7290d42aea0d495a7f7549fb9', 'request_id': 'req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.985874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] The token cache is being invalidate because project 14cdb6f7290d42aea0d495a7f7549fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:47.986152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.986810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0a6e7ae7-5f62-42bd-a362-a7c58c83db87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:47.988369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1074/2142] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:47 2022] DELETE /identity/v3/projects/14cdb6f7290d42aea0d495a7f7549fb9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:47.994845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:47.995289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:47.995400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.013107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:48.014298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.038323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:48.073298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1069/2143] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:48.082560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.082847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.083119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.090096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:48.104689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:48.105900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.113832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1075/2144] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:48.118653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.128515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1296-1990-4615-afc1-0cb78466d213 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.133930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.134640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.134918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.135186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.136055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:48.136364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.137954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.150667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1070/2145] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:12:48.154912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.164552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746a7a3-673d-4003-82d5-7a9195527463 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.169220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.169853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.170134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.170409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.171099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.173056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.198022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1076/2146] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:48.201965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.212036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd34cc-7732-4cc3-a3c3-df009f16241e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.258347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.260110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.268856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.269524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.269801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.270101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.270907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.272871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.292642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1071/2147] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:48.296615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.307036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f474e-bd4d-499f-a8c5-3a5964ed4744 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.312034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.312669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.312947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.313220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.313932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.315495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.325239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1072/2148] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:48.327294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7b52b-91ef-4eee-ba27-61c1a4c128a3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.328925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.332359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.333229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.333634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.333914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] PATH_INFO: `/v3/users/cf3b6ba8f85e4310819ff699c5631ba4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.335155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3b6ba8f85e4310819ff699c5631ba4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.337605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.338662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798281-8b7a-4ad2-b871-033d158a490a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.343503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.344175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.344458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.344732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.345445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.347110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.361344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1073/2149] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:48.362529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.372935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746acf67-3e0a-43ed-9b7a-2913e1a5d965 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.378478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.379428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.379613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.379940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] PATH_INFO: `/v3/projects/70c591ef488b4c0497f3a4a960b7ff97/users/d64c56921a7949d09bc44b59336cf16a/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.386075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3b6ba8f85e4310819ff699c5631ba4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:48.393833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3b6ba8f85e4310819ff699c5631ba4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:48.394518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3b6ba8f85e4310819ff699c5631ba4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:48.395249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3b6ba8f85e4310819ff699c5631ba4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:48.395547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c591ef488b4c0497f3a4a960b7ff97, user_id=d64c56921a7949d09bc44b59336cf16a, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.398721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d6551-d789-4752-97f4-b5e328fcb45c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.402980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-81b92924-938c-4955-8948-a2fbee95bc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3b6ba8f85e4310819ff699c5631ba4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:48.412852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1074/2150] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:48 2022] PUT /identity/v3/projects/70c591ef488b4c0497f3a4a960b7ff97/users/d64c56921a7949d09bc44b59336cf16a/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:48.425660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1077/2151] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:48 2022] DELETE /identity/v3/users/cf3b6ba8f85e4310819ff699c5631ba4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:48.425819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.425819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.425819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.427618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.427944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.428277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.445399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:48.446617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.452434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] MFA Rules not processed for user `d64c56921a7949d09bc44b59336cf16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:48.453628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.496312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:48.513056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1078/2152] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:48.520520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:48.525385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.526791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.540901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1075/2153] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:48.545435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.547417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.560938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e382f-b730-4fc4-b096-f300397fdad1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.565892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.566548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.566829 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.567103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.567943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.569850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.591372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa763-8ceb-4758-a9f3-fabde4479756 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.596156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.596862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.597153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.597432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.599994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1076/2154] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:48.604978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.612619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.614937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.632773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1079/2155] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:12:48.677550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d69-a696-493e-bea0-5d657db09288 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.683224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.684012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.684377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.684738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.685566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.688066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.720180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1077/2156] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:48 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:48.724487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.734535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1014de-977e-4254-8d86-625268dff962 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.739457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.740033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.740318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.740595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.741349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.743004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.758841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1080/2157] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:48.761707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.772099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75665-fa08-461d-a734-be737a084439 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.778017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.778909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.779191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.779478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] PATH_INFO: `/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0/users/246aa427357442da8ded7a33fce36815/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.799061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=547a9b3dfb784c0f9b836b6ed04ebde0, user_id=246aa427357442da8ded7a33fce36815, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.804607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.822052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1078/2158] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:48 2022] PUT /identity/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0/users/246aa427357442da8ded7a33fce36815/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:48.825970 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.838170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff97f36-d492-41a8-9fec-8de5586cdc26 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.905135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.905814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.906096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.906370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.907109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.908749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.919979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1081/2159] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:48.924504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.939139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2be058-9ccf-4c12-bab3-a67b3704ba8d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.954902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:48.956856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:48.964511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:48.966248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:48.968803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:48.969809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] PATH_INFO: `/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0/users/246aa427357442da8ded7a33fce36815/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:48.976672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=547a9b3dfb784c0f9b836b6ed04ebde0, user_id=246aa427357442da8ded7a33fce36815, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:48.980183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0689b-d60d-4583-9e84-75c53e078f2b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:48.988523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2f9a-9203-4225-96a6-dc533b57897c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:48.994156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1079/2160] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:48 2022] PUT /identity/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0/users/246aa427357442da8ded7a33fce36815/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:49.005862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.006505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.006505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.050051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] MFA Rules not processed for user `246aa427357442da8ded7a33fce36815`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:49.051581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.056303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.057248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.057594 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.057940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] PATH_INFO: `/v3/projects/ea1c19f063434fea97a59bf12ad6baf6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.059333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1c19f063434fea97a59bf12ad6baf6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.061247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.101541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:49.138963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1c19f063434fea97a59bf12ad6baf6', 'request_id': 'req-26359c75-e4f3-4f38-b72a-4251a7b3aba7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:49.140385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1080/2161] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:49.152774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.152995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1c19f063434fea97a59bf12ad6baf6', 'request_id': 'req-26359c75-e4f3-4f38-b72a-4251a7b3aba7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:49.154953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.164735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1c19f063434fea97a59bf12ad6baf6', 'request_id': 'req-26359c75-e4f3-4f38-b72a-4251a7b3aba7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:49.165691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:49.183215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] The token cache is being invalidate because project ea1c19f063434fea97a59bf12ad6baf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:49.183215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:49.183215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-26359c75-e4f3-4f38-b72a-4251a7b3aba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:49.185066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1082/2162] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:48 2022] DELETE /identity/v3/projects/ea1c19f063434fea97a59bf12ad6baf6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:49.190711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9efb3-18bb-4d3f-807c-506fcb408646 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.192210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9efb3-18bb-4d3f-807c-506fcb408646 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.192621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9efb3-18bb-4d3f-807c-506fcb408646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.229701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ed9efb3-18bb-4d3f-807c-506fcb408646 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:49.231514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ed9efb3-18bb-4d3f-807c-506fcb408646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.237489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0fab-9fca-4a2f-a9ca-2d30b0c356a4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.297656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.297656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.297656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.297656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.301088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.321949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1083/2163] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:49.329791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.330207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.330589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.352026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:49.353361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.363692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1084/2164] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:49.367620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.377596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66aabb-a234-4b5e-ab1f-c0e2c424aab9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.383432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.384285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.384667 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.385168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.385907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:49.386218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.389623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.397780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.399981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.402249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1085/2165] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:12:49.406510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.411621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1081/2166] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:12:49.418069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93f44-19e9-4145-9c26-01fa8626fa3c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.423051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.423693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.424008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.424292 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.424983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.426893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.472085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1086/2167] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:49.473688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.486806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8fb72-7d8d-43fa-ae60-30f06d3fc705 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.556366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.557742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.560275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.560582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.561303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.564030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.583396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:49.590531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1082/2168] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:49.599270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.609995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1ace-a265-48d4-9cfb-8beae71a50f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.616033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.618263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.618263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.618263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.618263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.619858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.631776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1087/2169] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:49.636341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.649827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fe4e6-98f0-451d-b631-b1aaced33434 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.659311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.659311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.659311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.659311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.659813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.660235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97a9d7-e14d-48c3-8c27-3d5178cf381e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.672376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1083/2170] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:49.676511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.695718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411e2a-bc44-4d04-a8df-fa007bed1766 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.704055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.705946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.706390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.706845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] PATH_INFO: `/v3/projects/cbd79cd5dd034dec885a0a56cd16b993/users/c7d0b7e3000444c1969640bfd27d72ba/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.726145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd79cd5dd034dec885a0a56cd16b993, user_id=c7d0b7e3000444c1969640bfd27d72ba, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.731517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.752843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1088/2171] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:49 2022] PUT /identity/v3/projects/cbd79cd5dd034dec885a0a56cd16b993/users/c7d0b7e3000444c1969640bfd27d72ba/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:49.758612 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.759086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.759557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.786210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:49.787499 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.909456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1084/2172] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:49.913944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.915672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.919526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:49.923660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:49.928837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484cb0-963e-4a6b-8715-4a9d878863eb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:49.934430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:49.935286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:49.935567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:49.935866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] PATH_INFO: `/v3/users/d64c56921a7949d09bc44b59336cf16a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:49.937091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64c56921a7949d09bc44b59336cf16a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:49.939017 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:49.994940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:50.015221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64c56921a7949d09bc44b59336cf16a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.016011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86519ce3-9b5d-4f87-8b8d-62f2ed955364 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:50.021184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:50.022045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:50.022361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:50.022639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:50.025125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64c56921a7949d09bc44b59336cf16a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.025953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64c56921a7949d09bc44b59336cf16a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.026750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64c56921a7949d09bc44b59336cf16a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.033449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:50.034978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cfe6e-073a-40ba-ba92-e15ef1edb6d1 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:50.040462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64c56921a7949d09bc44b59336cf16a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.046351 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1085/2173] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:50.064328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1089/2174] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:49 2022] DELETE /identity/v3/users/d64c56921a7949d09bc44b59336cf16a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:50.072142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624a6b-5083-440d-9546-d7089701a7da None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:50.072333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624a6b-5083-440d-9546-d7089701a7da None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:50.072696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59624a6b-5083-440d-9546-d7089701a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:50.105705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-59624a6b-5083-440d-9546-d7089701a7da None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:50.107485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59624a6b-5083-440d-9546-d7089701a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:50.187957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1086/2175] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:50.196330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:50.199111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:50.272498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4b256-16b7-4d92-ad00-a5b62e489411 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:50.276887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:50.277475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:50.277757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:50.278035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:50.288305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:50.289747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:50.299999 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1090/2176] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:50.757508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59624a6b-5083-440d-9546-d7089701a7da None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:50.759660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-59624a6b-5083-440d-9546-d7089701a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:50.780290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59624a6b-5083-440d-9546-d7089701a7da None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:50.786295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:50.787329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:50.787670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:50.788110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] PATH_INFO: `/v3/projects/70c591ef488b4c0497f3a4a960b7ff97` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:50.789372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c591ef488b4c0497f3a4a960b7ff97)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:50.791350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:50.828566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:50.851194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c591ef488b4c0497f3a4a960b7ff97', 'request_id': 'req-331200e5-0835-447c-b020-dd39d5367742'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.862616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c591ef488b4c0497f3a4a960b7ff97', 'request_id': 'req-331200e5-0835-447c-b020-dd39d5367742'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.880558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c591ef488b4c0497f3a4a960b7ff97', 'request_id': 'req-331200e5-0835-447c-b020-dd39d5367742'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.896594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] The token cache is being invalidate because project 70c591ef488b4c0497f3a4a960b7ff97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:50.896885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.897546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:50.899314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1087/2177] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:50 2022] DELETE /identity/v3/projects/70c591ef488b4c0497f3a4a960b7ff97 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:12:50.904049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:50.921741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec668cf-b6a1-4556-b126-1c21e651a039 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:51.008136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:51.009039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:51.009323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:51.009608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] PATH_INFO: `/v3/users/246aa427357442da8ded7a33fce36815` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:51.010838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246aa427357442da8ded7a33fce36815)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:51.012818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:51.104703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246aa427357442da8ded7a33fce36815'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.109662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:51.144837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246aa427357442da8ded7a33fce36815'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.145729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246aa427357442da8ded7a33fce36815'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.146811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246aa427357442da8ded7a33fce36815'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.157319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-625d721c-952a-407e-991d-48df422bda01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246aa427357442da8ded7a33fce36815'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.184588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1091/2178] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:50 2022] DELETE /identity/v3/users/246aa427357442da8ded7a33fce36815 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:51.634883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:51.637325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:51.658898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331200e5-0835-447c-b020-dd39d5367742 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:51.739597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:51.740650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:51.741005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:51.741355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] PATH_INFO: `/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:51.743735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547a9b3dfb784c0f9b836b6ed04ebde0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:51.745860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:51.806685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547a9b3dfb784c0f9b836b6ed04ebde0', 'request_id': 'req-948d3f28-a267-4577-a407-44782f3ac319'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.815817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547a9b3dfb784c0f9b836b6ed04ebde0', 'request_id': 'req-948d3f28-a267-4577-a407-44782f3ac319'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.823261 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547a9b3dfb784c0f9b836b6ed04ebde0', 'request_id': 'req-948d3f28-a267-4577-a407-44782f3ac319'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.835815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] The token cache is being invalidate because project 547a9b3dfb784c0f9b836b6ed04ebde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:51.836276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.837111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-948d3f28-a267-4577-a407-44782f3ac319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:51.838772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1088/2179] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:51 2022] DELETE /identity/v3/projects/547a9b3dfb784c0f9b836b6ed04ebde0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:51.844167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:51.844654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:51.844734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:51.863613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:51.864894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:51.957548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1092/2180] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:51.965654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:51.966392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:51.966821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.001761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:52.003111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:52.019020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1089/2181] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:52.022858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.040252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6561f-b4a2-4dfb-9263-fb4816fb7120 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.045401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.046205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.046567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.046924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.047749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:52.048473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.050192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.065822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1093/2182] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:12:52.070328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.080472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f740fb-81eb-4d09-99a5-afa99668618c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.086356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.087060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.087338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.089416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.090122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.092046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.120377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1090/2183] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:52 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:52.124743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.136446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96950-a323-4ab3-b309-d2fdd84a6810 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.236804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.237482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.237768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.238099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.238845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.241140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.269820 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1094/2184] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:52 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:52.274448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.285733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b144-3348-4152-a170-f710697d56c4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.292527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.294079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.294433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.294780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.295630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.297429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.309705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1091/2185] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:52.313696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.325070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37ccb-6a1f-43c4-8c74-74584054b1ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.330705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.334907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.334907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.334907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.334907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.334907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654ef58-6f83-4b5d-bd17-d7e18feede6c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.348015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1095/2186] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:52.352721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.363334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894215-a5d1-4600-a7b3-c99c3c62f532 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.367908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.368798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.369071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.369381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] PATH_INFO: `/v3/projects/921584ed0e7b46bb8f8944666d96268a/users/055a69a7d73546de93e10fbd1398f384/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.373191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:52.387707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921584ed0e7b46bb8f8944666d96268a, user_id=055a69a7d73546de93e10fbd1398f384, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.390562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.403830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1092/2187] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:52 2022] PUT /identity/v3/projects/921584ed0e7b46bb8f8944666d96268a/users/055a69a7d73546de93e10fbd1398f384/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:52.414717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.415008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.415287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.443381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] MFA Rules not processed for user `055a69a7d73546de93e10fbd1398f384`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:52.445813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:52.470637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:52.516907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1096/2188] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:52.521036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.592848 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520adfcc-19ce-4739-8e13-803e51346927 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.597897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.598631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.599088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.599359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.600175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.602533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.637039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1093/2189] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:52 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:52.641543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.662499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e5d5-c400-4d5b-9dab-d4c929262554 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.746228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.747107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.747398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.747677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.748467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.750910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.780026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1097/2190] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:52 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:52.781452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.797405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c726e-d6ce-449e-bce6-8329c033363f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.805383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.809221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.809734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.810114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.812037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.814421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.830468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1094/2191] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:12:52.834699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:52.850777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145754a6-1fb7-4fde-95ce-c01f64903753 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:52.872009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:52.872955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:52.873241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:52.873521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] PATH_INFO: `/v3/projects/ba523239d5a949c49f5009a5cef204bb/users/acf2be4827634c478f18d59f5005dca1/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:52.915027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba523239d5a949c49f5009a5cef204bb, user_id=acf2be4827634c478f18d59f5005dca1, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:52.925703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:52.965072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1098/2192] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:52 2022] PUT /identity/v3/projects/ba523239d5a949c49f5009a5cef204bb/users/acf2be4827634c478f18d59f5005dca1/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:52.969366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:53.004400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf9713-a188-4e1e-ad21-cad409b4df78 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:53.138592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:53.139284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:53.139572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:53.142669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:53.143390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:53.147808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7eff-3d58-4053-a322-8278f3138f93 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:53.191800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1095/2193] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:53.197620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:53.213235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217914b-a6f2-4eee-b3b2-4151d6966c84 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:53.224702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:53.225998 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:53.227036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:53.228235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] PATH_INFO: `/v3/projects/ba523239d5a949c49f5009a5cef204bb/users/acf2be4827634c478f18d59f5005dca1/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:53.231619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba523239d5a949c49f5009a5cef204bb, user_id=acf2be4827634c478f18d59f5005dca1, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:53.234383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:53.249994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1099/2194] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:53 2022] PUT /identity/v3/projects/ba523239d5a949c49f5009a5cef204bb/users/acf2be4827634c478f18d59f5005dca1/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:53.260905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:53.261192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:53.261472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:53.308416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] MFA Rules not processed for user `acf2be4827634c478f18d59f5005dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:53.309878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:53.373531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:53.422477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1096/2195] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:53.437124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:53.438858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:53.521393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193efc24-5c70-47fb-8bcd-f2daf190d12f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:53.529199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:53.529871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:53.530151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:53.530424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:53.551450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:53.552964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:53.576774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1100/2196] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:53.683417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:53.699157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ea937-7c3f-49b0-9843-1cc4325f833c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:53.703725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:53.704444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:53.704720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:53.705190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:53.859142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:53.861213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc09a2-6bc8-442a-bb6f-8ec26bbcb3bc service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:53.897222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1097/2197] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:54.304949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:54.344889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:54.462633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c9f6-ccb3-437e-90f3-7f71c2416750 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:54.476136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:54.477227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:54.477659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:54.477956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] PATH_INFO: `/v3/users/055a69a7d73546de93e10fbd1398f384` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:54.479198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055a69a7d73546de93e10fbd1398f384)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:54.481179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:54.579941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055a69a7d73546de93e10fbd1398f384'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:54.593198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055a69a7d73546de93e10fbd1398f384'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:54.594463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055a69a7d73546de93e10fbd1398f384'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:54.595405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055a69a7d73546de93e10fbd1398f384'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:54.604777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055a69a7d73546de93e10fbd1398f384'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:54.634658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1101/2198] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:54 2022] DELETE /identity/v3/users/055a69a7d73546de93e10fbd1398f384 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:54.639458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fe7-c6f2-4b91-9922-935511af48c0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:54.641245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fe7-c6f2-4b91-9922-935511af48c0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:54.641607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85fe7-c6f2-4b91-9922-935511af48c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:54.671232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-22d85fe7-c6f2-4b91-9922-935511af48c0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:54.674057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-22d85fe7-c6f2-4b91-9922-935511af48c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:54.770957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1098/2199] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:54.787450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:54.792016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:54.798388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:54.798963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:54.799637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:54.820061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] MFA Rules not processed for user `1c00db02926f4d849249c3990fdf8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:54.821870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:54.899544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d03d2-0122-4af7-8cd5-f8e3e9979be5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:54.912556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:54.915580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:54.916229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:54.916516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:54.926466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1099/2200] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:54.936691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:54.939860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94123f-a18f-4777-a562-8dbba6e15281 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:54.969639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1102/2201] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:54.980910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:54.982540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:55.007357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c8d9-c37d-4f12-88cf-63e06e322e6d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:55.012417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:55.013700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:55.013926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:55.014200 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] PATH_INFO: `/v3/users/f1aae8526b6d4b0eb0bff5b3eaa80273` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:55.015577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1aae8526b6d4b0eb0bff5b3eaa80273)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:55.017611 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:55.034899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:55.077065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1aae8526b6d4b0eb0bff5b3eaa80273'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.090597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1aae8526b6d4b0eb0bff5b3eaa80273'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.092042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1aae8526b6d4b0eb0bff5b3eaa80273'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.106128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1aae8526b6d4b0eb0bff5b3eaa80273'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.120945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1aae8526b6d4b0eb0bff5b3eaa80273'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.131719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1100/2202] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:54 2022] DELETE /identity/v3/users/f1aae8526b6d4b0eb0bff5b3eaa80273 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:55.133585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:55.134737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:55.135315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:55.159242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:55.160746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:55.218309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:55.254773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1103/2203] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:55.266214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:55.268267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:55.377306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3ffe-d369-4a2c-bdb8-87e9ee0d920b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:55.387575 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:55.388174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:55.388466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:55.388735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:55.416506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:55.418454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d169f66-b206-4ba1-9b6f-9baf96881b21 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:55.438650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1101/2204] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:55.701296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:55.703038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:55.749893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b700d2a-22d2-496e-bd44-84b6547d352f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:55.766812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:55.767756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:55.768071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:55.768931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] PATH_INFO: `/v3/projects/921584ed0e7b46bb8f8944666d96268a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:55.769787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] RBAC: Authorizing `identity:delete_project(project_id=921584ed0e7b46bb8f8944666d96268a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:55.771716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:55.805879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:55.806335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:55.806441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:55.854528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] MFA Rules not processed for user `c7d0b7e3000444c1969640bfd27d72ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:55.855767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:55.893808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921584ed0e7b46bb8f8944666d96268a', 'request_id': 'req-ea5f1074-48ac-4da6-8482-5a60d30561de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.904261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921584ed0e7b46bb8f8944666d96268a', 'request_id': 'req-ea5f1074-48ac-4da6-8482-5a60d30561de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.913319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921584ed0e7b46bb8f8944666d96268a', 'request_id': 'req-ea5f1074-48ac-4da6-8482-5a60d30561de'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.949277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] The token cache is being invalidate because project 921584ed0e7b46bb8f8944666d96268a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:55.950034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.951982 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:55.955560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1104/2205] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:55 2022] DELETE /identity/v3/projects/921584ed0e7b46bb8f8944666d96268a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:55.960308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:55.972747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.043814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1102/2206] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:56.043814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.043814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.091121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:56.126575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f1074-48ac-4da6-8482-5a60d30561de admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.137666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.138761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.139042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.139325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] PATH_INFO: `/v3/users/acf2be4827634c478f18d59f5005dca1` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.140844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf2be4827634c478f18d59f5005dca1)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.142784 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.144983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d607-c9db-49e3-9f31-1c43d6ec80c9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.149792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.150660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.150947 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.151224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] PATH_INFO: `/v3/projects/54af18468cec4f8ba59e9a7e134e3705` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.152473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54af18468cec4f8ba59e9a7e134e3705)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.154402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.206778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf2be4827634c478f18d59f5005dca1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.217288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf2be4827634c478f18d59f5005dca1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.217937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf2be4827634c478f18d59f5005dca1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.218562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf2be4827634c478f18d59f5005dca1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.219274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54af18468cec4f8ba59e9a7e134e3705', 'request_id': 'req-79d80095-ba8d-4713-b240-ddb3209f9b6f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.226962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf2be4827634c478f18d59f5005dca1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.232647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54af18468cec4f8ba59e9a7e134e3705', 'request_id': 'req-79d80095-ba8d-4713-b240-ddb3209f9b6f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.234193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:56.243358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54af18468cec4f8ba59e9a7e134e3705', 'request_id': 'req-79d80095-ba8d-4713-b240-ddb3209f9b6f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.259275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] The token cache is being invalidate because project 54af18468cec4f8ba59e9a7e134e3705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:56.259594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.261520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.265050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1103/2207] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:56 2022] DELETE /identity/v3/projects/54af18468cec4f8ba59e9a7e134e3705 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:56.269708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1105/2208] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:12:55 2022] DELETE /identity/v3/users/acf2be4827634c478f18d59f5005dca1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:56.272501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.274845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.475883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80095-ba8d-4713-b240-ddb3209f9b6f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.582901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.584184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.584487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.584812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.585581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.591432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.603383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:56.628385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1104/2209] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:56 2022] POST /identity/v3/projects => generated 383 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:56.633431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.635815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.656722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4c715-ddd2-4b5a-9aa6-ec1ac272edd9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.709047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.712213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.733724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.734534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.734902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.735246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.736084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.738790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.775145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1106/2210] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:56 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:56.776657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.779534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.797032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b26ab-558d-4b2c-8997-67fdd5ebfbcf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.803046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.804100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.804796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.804796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] PATH_INFO: `/v3/projects/ba523239d5a949c49f5009a5cef204bb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.810031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba523239d5a949c49f5009a5cef204bb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.810031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.848804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7732-90e7-4c0d-b7b5-89c4d4c8b667 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.855104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:56.855952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.856236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.856513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.861489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:56.874259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:56.876075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:56.878581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba523239d5a949c49f5009a5cef204bb', 'request_id': 'req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.891915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1105/2211] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:12:56.892912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:56.909203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba523239d5a949c49f5009a5cef204bb', 'request_id': 'req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.909446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38969e-64e0-4ed1-8c23-4e2721b41692 service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:56.924242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba523239d5a949c49f5009a5cef204bb', 'request_id': 'req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.942974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] The token cache is being invalidate because project ba523239d5a949c49f5009a5cef204bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:12:56.943274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.944225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-23c3d4f6-9adb-426d-b573-d9bff9f9dce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:12:56.946828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1107/2212] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:12:56 2022] DELETE /identity/v3/projects/ba523239d5a949c49f5009a5cef204bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:56.954758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f94d3-c572-4b67-a9d5-b95c4775f8ef None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:56.955044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f94d3-c572-4b67-a9d5-b95c4775f8ef None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:56.955327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f94d3-c572-4b67-a9d5-b95c4775f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:56.979969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b04f94d3-c572-4b67-a9d5-b95c4775f8ef None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:56.981353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b04f94d3-c572-4b67-a9d5-b95c4775f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:57.000017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.000850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.001420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.001801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.002896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.005919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.017958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1106/2213] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:57.029698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.031777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:57.045246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:57.047581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6aa93-e278-45af-bbce-ea1b1050b8c4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.054871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.056234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.056709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.057105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] PATH_INFO: `/v3/projects/ddbe4448c23c4277b32a95293e5ffedf/users/859c4c23fa4c4c75bb5e297a227969ae/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.059971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1108/2214] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:12:57.069002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.069218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.069758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.083432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbe4448c23c4277b32a95293e5ffedf, user_id=859c4c23fa4c4c75bb5e297a227969ae, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.087468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.109951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1107/2215] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:57 2022] PUT /identity/v3/projects/ddbe4448c23c4277b32a95293e5ffedf/users/859c4c23fa4c4c75bb5e297a227969ae/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:57.114101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.138524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:57.147282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:57.181163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:57.236259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fa7b2-0301-4fb9-87e3-e327dafc9e2f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.243471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.244290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.244476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.244755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.245713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.248517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.277036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1108/2216] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:57.280935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.295779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1109/2217] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:57.300504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.315737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6f64c-a512-4659-85f5-1e43b51672f2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.316306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d122-410e-41a2-81c1-31aa75c7445e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.321228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.322055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.322209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.322455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.322730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] PATH_INFO: `/v3/projects/ddbe4448c23c4277b32a95293e5ffedf/users/859c4c23fa4c4c75bb5e297a227969ae/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.322966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.323248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.323540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.324340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:12:57.324747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.326352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbe4448c23c4277b32a95293e5ffedf, user_id=859c4c23fa4c4c75bb5e297a227969ae, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.326658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.329059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.339976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1110/2218] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:12:57.344370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.345266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1109/2219] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:57 2022] PUT /identity/v3/projects/ddbe4448c23c4277b32a95293e5ffedf/users/859c4c23fa4c4c75bb5e297a227969ae/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:57.354255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef45fe-94e7-4b81-bbb8-a46ef0f5b054 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.415732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.416636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.416768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.417048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.417875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.419788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.449380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1111/2220] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:12:57.454445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.470102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96d2e-ddb3-447c-a5d9-449b04bd9fd3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.545532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.546284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.546637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.547307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.548109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.550141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.571705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1110/2221] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:12:57 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:12:57.575573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.586045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad200a-93ab-4f60-a159-ce3429c7b7dd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.590769 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.591432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.591720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.592060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.592768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.594517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.605106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1112/2222] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:57.609587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.622879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffe83d-b8ef-479c-bdae-4052bdd13181 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.628111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.628793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.629078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.629360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.630092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.631700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a23a6-2c2a-45c9-a4bb-802e53e17c3c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.646914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1111/2223] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:12:57.648204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.666285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0326d-df00-4a5b-b75a-39b0d2cdceaa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:57.671288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:57.672389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.672674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.673021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] PATH_INFO: `/v3/projects/77fe9a6977424c22bb62c748c2565198/users/1c14f898bff249798d0ebef0f05a3012/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.700206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77fe9a6977424c22bb62c748c2565198, user_id=1c14f898bff249798d0ebef0f05a3012, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:57.703119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:57.727913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1113/2224] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:12:57 2022] PUT /identity/v3/projects/77fe9a6977424c22bb62c748c2565198/users/1c14f898bff249798d0ebef0f05a3012/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:12:57.735074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8991f-f5fd-41d7-87ba-6fbaf69ebde0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:57.735414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8991f-f5fd-41d7-87ba-6fbaf69ebde0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:57.735700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8991f-f5fd-41d7-87ba-6fbaf69ebde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:57.797582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b5f8991f-f5fd-41d7-87ba-6fbaf69ebde0 None None] MFA Rules not processed for user `1c14f898bff249798d0ebef0f05a3012`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:12:57.799890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b5f8991f-f5fd-41d7-87ba-6fbaf69ebde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:57.904548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1112/2225] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:12:57.911473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:12:57.919940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:12:57.968393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:12:57.996783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b91e6-fc59-43e5-b9e8-f68b55f41858 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:12:58.002685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:12:58.003403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:12:58.003695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:12:58.004003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:12:58.014202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:12:58.015920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:12:58.025159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1114/2226] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:12:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:13:02.909590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298439c7-f2a7-43d0-aff4-7b1494d5cbfd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:02.910780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298439c7-f2a7-43d0-aff4-7b1494d5cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:02.911250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298439c7-f2a7-43d0-aff4-7b1494d5cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:02.946392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-298439c7-f2a7-43d0-aff4-7b1494d5cbfd None None] MFA Rules not processed for user `859c4c23fa4c4c75bb5e297a227969ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:02.947624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-298439c7-f2a7-43d0-aff4-7b1494d5cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:02.967535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:03.043957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1113/2227] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:03.057405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:03.058889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:03.164210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d1a5d-6ee2-40bd-a6b0-a8cfe75bbc22 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:03.168458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:03.169113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:03.169393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:03.169671 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:03.171461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:03.234254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:03.235696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:03.249087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1115/2228] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:13:03.412192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:03.412486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:03.412769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:03.478635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:03.480050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:03.557801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1114/2229] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:13:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:03.604333 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:03.605799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:03.693187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:03.706817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11127fba-7725-4d78-b52d-8a5772c8f954 service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:03.712551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:03.713208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:03.713488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:03.713764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:03.722629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:03.724268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85adea9-4a14-4f6e-82ad-f6c47c308a30 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:03.733772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1116/2230] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:09.510071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:09.592731 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8915-defa-4481-a9e1-248c8edc285f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:09.597542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:09.598514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:09.598873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:09.599231 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] PATH_INFO: `/v3/users/1c14f898bff249798d0ebef0f05a3012` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:09.600530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c14f898bff249798d0ebef0f05a3012)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:09.603204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:09.608664 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:09.668860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c14f898bff249798d0ebef0f05a3012'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:09.681697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c14f898bff249798d0ebef0f05a3012'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:09.682394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c14f898bff249798d0ebef0f05a3012'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:09.691963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c14f898bff249798d0ebef0f05a3012'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:09.708310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c14f898bff249798d0ebef0f05a3012'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:09.719967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1115/2231] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:13:09 2022] DELETE /identity/v3/users/1c14f898bff249798d0ebef0f05a3012 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:13:09.724318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:09.724859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:09.724859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:09.746089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:09.747303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:09.849026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1117/2232] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:09.859211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:09.860780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:10.014000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0edd40-8b3f-4ca4-aa5a-f720294e61d5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:10.045558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:10.046635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.047271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.047782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.061237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:10.062829 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a6ac5-4a05-4e2b-82e4-ba6a73e33ee2 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:10.081026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1116/2233] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:13:10.453481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:10.455299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:10.502414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b30cb2-fbdb-4cd3-a935-eb985986cf36 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:10.507919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:10.508956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.509338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.509754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] PATH_INFO: `/v3/projects/77fe9a6977424c22bb62c748c2565198` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.511063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77fe9a6977424c22bb62c748c2565198)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:10.513252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:10.574301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77fe9a6977424c22bb62c748c2565198', 'request_id': 'req-38106b4b-9b73-488e-b1cb-1b672fbdf918'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:10.585375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77fe9a6977424c22bb62c748c2565198', 'request_id': 'req-38106b4b-9b73-488e-b1cb-1b672fbdf918'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:10.592600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77fe9a6977424c22bb62c748c2565198', 'request_id': 'req-38106b4b-9b73-488e-b1cb-1b672fbdf918'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:10.608070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] The token cache is being invalidate because project 77fe9a6977424c22bb62c748c2565198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:13:10.608682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:10.609516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-38106b4b-9b73-488e-b1cb-1b672fbdf918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:10.611053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1118/2234] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:13:10 2022] DELETE /identity/v3/projects/77fe9a6977424c22bb62c748c2565198 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:13:10.616193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.616686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.616816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.636585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:10.638063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:10.711863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1117/2235] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:10.720679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.721058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.721437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.740609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:10.742013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:10.751126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1119/2236] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:10.757109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:10.767718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359549d-8cf0-47e1-8bee-01a7c0f95a34 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:10.775103 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:10.775959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.776311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.776662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.777481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:13:10.777860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:10.779560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:10.799865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1118/2237] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:13:10.802950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:10.816528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aba40f-884f-4c60-abb9-8c42205cc054 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:10.821660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:10.822319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.822605 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.822884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.823601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:10.825632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:10.864291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1120/2238] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:13:10 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:13:10.865179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:10.879138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569712-b7a1-4c45-9e44-cec56544ff20 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:10.894088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:10.954851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:10.955678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:10.956087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:10.956457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:10.957474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:10.959508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:10.985662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1119/2239] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:13:10 2022] POST /identity/v3/users => generated 280 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:13:10.989350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.001503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf6b74-7aaa-43cc-b79e-84ef2b505ffa admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.009439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.010960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.011613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.012227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.013406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.015052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.030895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1121/2240] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:13:11.034742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.047909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1412ad-f1bd-40f4-bedb-05581a417c6d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.053846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.054839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.055218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.055646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.056518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.058193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021fb72-f460-4244-b354-dee74106a8a7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.073735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1120/2241] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:13:11.074859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.095872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026677f-db29-4f3e-926b-8cb1669a0d46 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.100967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.102410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.102768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.103038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] PATH_INFO: `/v3/projects/dd5f1212c2a14cfc885b5bfc49050770/users/0f9736f617374291a52c9dcf4b76dd1b/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.122550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5f1212c2a14cfc885b5bfc49050770, user_id=0f9736f617374291a52c9dcf4b76dd1b, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.125506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.143393 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1122/2242] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:13:11 2022] PUT /identity/v3/projects/dd5f1212c2a14cfc885b5bfc49050770/users/0f9736f617374291a52c9dcf4b76dd1b/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:13:11.155156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.155433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.155712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.185246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] MFA Rules not processed for user `0f9736f617374291a52c9dcf4b76dd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:11.186477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:11.272324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1121/2243] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:11.302310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.304294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:11.315576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:11.380771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602317d-66d2-4186-9a7a-10a817502be0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.386259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.387302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.387754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.388063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.397379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.399409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40964885-e42d-446a-a62c-a75d5d0bd2c1 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.409240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1123/2244] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:11 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:13:11.426380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.499662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5ade-f082-4240-833f-9005e95080a5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.509875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.510977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.511355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.511742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] PATH_INFO: `/v3/users/0f9736f617374291a52c9dcf4b76dd1b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.513170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9736f617374291a52c9dcf4b76dd1b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.515191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.540539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:11.573348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9736f617374291a52c9dcf4b76dd1b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:11.584260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9736f617374291a52c9dcf4b76dd1b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:11.584898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9736f617374291a52c9dcf4b76dd1b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:11.592771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9736f617374291a52c9dcf4b76dd1b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:11.606293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9736f617374291a52c9dcf4b76dd1b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:11.613163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1122/2245] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:13:11 2022] DELETE /identity/v3/users/0f9736f617374291a52c9dcf4b76dd1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:13:11.618249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.620747 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.622015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.642943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:11.644113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:11.715311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1124/2246] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:11.725031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:11.726621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:11.795417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977577-fb14-469d-adfc-a6f07bd63381 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:11.799522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:11.800410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:11.800961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:11.801400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:11.813473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:11.815389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519cbea-289c-4814-9019-eceef0352a7e service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:11.828125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1123/2247] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:13:12.168251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.170502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:12.183954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222250e7-ceb9-4bd3-b3b2-e9ca5d7c3101 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.195728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.197069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.197069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.197069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] PATH_INFO: `/v3/projects/dd5f1212c2a14cfc885b5bfc49050770` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.198054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5f1212c2a14cfc885b5bfc49050770)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.200044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.263085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5f1212c2a14cfc885b5bfc49050770', 'request_id': 'req-a322e58c-52d4-4111-9820-f3776561bcd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:12.273821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5f1212c2a14cfc885b5bfc49050770', 'request_id': 'req-a322e58c-52d4-4111-9820-f3776561bcd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:12.282475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5f1212c2a14cfc885b5bfc49050770', 'request_id': 'req-a322e58c-52d4-4111-9820-f3776561bcd6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:12.297702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] The token cache is being invalidate because project dd5f1212c2a14cfc885b5bfc49050770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:13:12.297992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:12.298654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a322e58c-52d4-4111-9820-f3776561bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:12.300285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1125/2248] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:13:12 2022] DELETE /identity/v3/projects/dd5f1212c2a14cfc885b5bfc49050770 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:13:12.306485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.306962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.307502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.344838 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:12.346080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:12.451867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1124/2249] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:12.457937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.458334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.458795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.482606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:12.484050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:12.494221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1126/2250] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:12.499254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.514464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524b1f-2c86-4952-ac05-88075cf66b3e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.519845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.520429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.520709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.520977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.521722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:13:12.522008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.523795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.548610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1125/2251] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:13:12.549927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.563487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adf0c3-855b-483c-bff5-41913e6d2512 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.568659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.569315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.569688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.569966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.571224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.573262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.615366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:12.634345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1127/2252] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:13:12 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:13:12.636084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.650304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971ee1f-bbb0-4ee6-8c69-022c97e2e63b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.701866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:12.744476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.745220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.745498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.745767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.746478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.748467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.778796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1126/2253] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:13:12 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:13:12.780158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.791694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01045d32-ec5d-4a78-a602-395a4e8e9ecd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.796552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.797876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.798171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.798449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.799201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.801146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.818833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1128/2254] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:13:12.819297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.830260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130a5da-f859-459f-af7f-3839648d5ca8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.835402 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.836466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.836926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.837209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.837957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.839607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470db04-0bbd-4441-a62c-91d76c2f7d42 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.860533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1127/2255] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:13:12.860774 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:12.872810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977af36-db50-4913-8523-18b51c454e95 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:12.878157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:12.879071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.879358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.879636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] PATH_INFO: `/v3/projects/5175c3cc5ca74d07883332f918ca6403/users/10438d22afcd45e8a6cb8fb5b119c4db/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.898618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5175c3cc5ca74d07883332f918ca6403, user_id=10438d22afcd45e8a6cb8fb5b119c4db, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:12.903446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:12.926626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1129/2256] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:13:12 2022] PUT /identity/v3/projects/5175c3cc5ca74d07883332f918ca6403/users/10438d22afcd45e8a6cb8fb5b119c4db/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:13:12.938127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d092-c461-44aa-a70f-bb50cf0ed168 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:12.938460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d092-c461-44aa-a70f-bb50cf0ed168 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:12.938687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d092-c461-44aa-a70f-bb50cf0ed168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:12.979930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ca06d092-c461-44aa-a70f-bb50cf0ed168 None None] MFA Rules not processed for user `10438d22afcd45e8a6cb8fb5b119c4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:12.979930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ca06d092-c461-44aa-a70f-bb50cf0ed168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:13.077391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1128/2257] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:13:13.089042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:13.091287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:13.164880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1ade-b192-4a45-b188-ffb45bf522ba admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:13.168586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:13.169251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:13.169519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:13.171892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:13.179512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:13.181545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c089b-d573-4207-84ca-854c1adeff0b service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:13.192199 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1130/2258] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:13:13.704690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553d2d-e443-4516-8f42-33f760f57b51 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:13.705167 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553d2d-e443-4516-8f42-33f760f57b51 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:13.705495 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553d2d-e443-4516-8f42-33f760f57b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:13.728165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c1553d2d-e443-4516-8f42-33f760f57b51 None None] MFA Rules not processed for user `c7d0b7e3000444c1969640bfd27d72ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:13.729364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1553d2d-e443-4516-8f42-33f760f57b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:13.785435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1129/2259] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:14.576136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:14.576666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:14.576786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:14.593250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] MFA Rules not processed for user `10438d22afcd45e8a6cb8fb5b119c4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:14.594484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:14.601681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1131/2260] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:22.586776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6e71-10fc-4f0c-8047-bf4b93c81f94 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:22.588529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6e71-10fc-4f0c-8047-bf4b93c81f94 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:22.588819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6e71-10fc-4f0c-8047-bf4b93c81f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:22.608260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-71de6e71-10fc-4f0c-8047-bf4b93c81f94 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:22.609606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-71de6e71-10fc-4f0c-8047-bf4b93c81f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:22.651940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:22.667692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1130/2261] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:22.679375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:22.681914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:22.751787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2c694-4a10-4e34-98a3-7daeaca10bdc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:22.756817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:22.757632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:22.758513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:22.758886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:22.767356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:22.768962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:22.777311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1132/2262] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:32.660927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:32.774819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:49.658347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd618-75af-46d0-ac33-f5de48e246dc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:49.658827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd618-75af-46d0-ac33-f5de48e246dc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:49.658914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecd618-75af-46d0-ac33-f5de48e246dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:49.676761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-caecd618-75af-46d0-ac33-f5de48e246dc None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:49.677973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-caecd618-75af-46d0-ac33-f5de48e246dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:49.685808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1131/2263] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:49.698069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:49.708479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ed200-dd69-4ad0-85b0-d5e45e69a068 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:49.713390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:49.714001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:49.714278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:49.714551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:49.723181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:49.724801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:49.735528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1133/2264] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:50.286106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7fa3-5f1a-489b-aaa9-dc413b5b5f41 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:50.286597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7fa3-5f1a-489b-aaa9-dc413b5b5f41 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:50.287059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7fa3-5f1a-489b-aaa9-dc413b5b5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:50.310890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fb1f7fa3-5f1a-489b-aaa9-dc413b5b5f41 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:50.312250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fb1f7fa3-5f1a-489b-aaa9-dc413b5b5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:50.320070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1132/2265] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:13:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:50.344061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:50.355103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e3df6-bef3-4685-8f94-29f0f53d090d service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:50.360413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:50.361081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:50.361413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:50.361922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:50.371056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:50.372860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:50.381515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1134/2266] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:50.572090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391023-7496-4fe2-9763-0aed61a366de None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:50.574738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391023-7496-4fe2-9763-0aed61a366de None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:50.575033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94391023-7496-4fe2-9763-0aed61a366de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:50.593823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-94391023-7496-4fe2-9763-0aed61a366de None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:50.595011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-94391023-7496-4fe2-9763-0aed61a366de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:50.601962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1133/2267] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:13:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:50.613978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:50.624183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284dfc-0a30-4c0a-b0f5-4aa3ac9e4435 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:50.629299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:50.629919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:50.630198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:50.630469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:50.639921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:50.641480 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:50.649390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1135/2268] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:50.966363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:50.966804 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:50.966916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:50.984222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:50.985410 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:50.992632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1134/2269] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:13:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:51.005169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:51.016361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59552-10e1-41bb-9427-85f71dc03faf service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:51.021429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:51.022072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:51.022357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:51.022635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:51.030796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:51.032389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f6ae6-81b1-40ad-9bb1-511e414fc367 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:51.042036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1136/2270] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:13:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:13:53.152363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:53.214640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ea20-4955-4687-8453-1a058757be8d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:53.219148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:53.220039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:53.220312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:53.220587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] PATH_INFO: `/v3/users/10438d22afcd45e8a6cb8fb5b119c4db` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:53.221771 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=10438d22afcd45e8a6cb8fb5b119c4db)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:53.223691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:53.269032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10438d22afcd45e8a6cb8fb5b119c4db'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.277578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10438d22afcd45e8a6cb8fb5b119c4db'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.278191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10438d22afcd45e8a6cb8fb5b119c4db'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.284879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10438d22afcd45e8a6cb8fb5b119c4db'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.297078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10438d22afcd45e8a6cb8fb5b119c4db'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.303102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1135/2271] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:13:53 2022] DELETE /identity/v3/users/10438d22afcd45e8a6cb8fb5b119c4db => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:13:53.307602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:53.308114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:53.308222 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:53.325473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:13:53.326678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:53.385205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1137/2272] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:13:53.394724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:53.396148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:53.453629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803c84-90be-40b8-9e86-e56112edd4de admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:53.457373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:53.458014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:53.458304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:53.458582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:53.466503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:13:53.469284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:53.471373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:53.482223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1136/2273] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:13:53.648794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:13:53.650250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:13:53.662310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b027ad-5e57-4fbe-8cf5-9af8c3e29929 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:13:53.667000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:13:53.668409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:13:53.668712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:13:53.668997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] PATH_INFO: `/v3/projects/5175c3cc5ca74d07883332f918ca6403` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:13:53.670359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5175c3cc5ca74d07883332f918ca6403)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:13:53.672359 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:13:53.718345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5175c3cc5ca74d07883332f918ca6403', 'request_id': 'req-21c5a221-544c-4ebc-959c-50860178bb63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.724986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5175c3cc5ca74d07883332f918ca6403', 'request_id': 'req-21c5a221-544c-4ebc-959c-50860178bb63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.731685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5175c3cc5ca74d07883332f918ca6403', 'request_id': 'req-21c5a221-544c-4ebc-959c-50860178bb63'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.742234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] The token cache is being invalidate because project 5175c3cc5ca74d07883332f918ca6403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:13:53.742525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.743212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-21c5a221-544c-4ebc-959c-50860178bb63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:13:53.745027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1138/2274] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:13:53 2022] DELETE /identity/v3/projects/5175c3cc5ca74d07883332f918ca6403 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:14:00.704448 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:00.705984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:00.718765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b725-4339-45bc-8712-7f70231b24b9 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:00.769185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:00.769825 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:00.770107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:00.770378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:00.772166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:00.833761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:00.835300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ca38a-a59a-48ca-aa5a-254d2ac83b83 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:00.846480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1137/2275] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:03.739284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:10.495745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:10.496953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:10.496953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:10.514986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] MFA Rules not processed for user `2020c486ef3e4fceb1d671269668ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:10.516255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:10.568611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1139/2276] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:14:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:10.841696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=52 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:20.562054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:27.627420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:27.627996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:27.628123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:27.647551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:27.648827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:27.712215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1138/2277] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:27.733849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:27.736105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:27.817569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70740dad-022b-40de-aaea-4b2de96456f9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:27.824457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:27.825150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:27.825481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:27.825808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:27.836040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:27.837703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6594e-32b6-48f9-ac12-59ef7887a513 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:27.846197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1140/2278] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:14:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:14:37.705142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:37.842788 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:14:43.113682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:43.115110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.170834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3767d1-1199-4617-8f1e-c5c19334cbba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:43.174426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:43.175059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.175342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.175618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.177394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.256763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:43.258125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e4465-a1d3-4185-9ab6-88961dd860a5 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:43.278219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1139/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:43.599105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.599640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.599640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.601068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1141/2280] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:14:43.606799 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82333b1-cb14-4b4a-b494-48701e63e78a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.607118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82333b1-cb14-4b4a-b494-48701e63e78a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.607465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82333b1-cb14-4b4a-b494-48701e63e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.645487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c82333b1-cb14-4b4a-b494-48701e63e78a None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:43.646830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c82333b1-cb14-4b4a-b494-48701e63e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.656269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1140/2281] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:43.668062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:43.669965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.729363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e50c8-ae0c-4e19-9e2a-8cfc59a8286b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:43.733464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:43.734103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.734385 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.734659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.744518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:43.745926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a724f-f0af-4493-a552-e7a66a843224 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:43.757324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1142/2282] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:43.822033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.822236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.822493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.823892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1141/2283] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:14:43.828879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83a3e-e96b-4b9a-9efc-10a7f1810b70 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.829173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83a3e-e96b-4b9a-9efc-10a7f1810b70 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.829479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83a3e-e96b-4b9a-9efc-10a7f1810b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.864873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-64c83a3e-e96b-4b9a-9efc-10a7f1810b70 None None] MFA Rules not processed for user `076ef080a9444bea928197a18d546cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:43.866076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64c83a3e-e96b-4b9a-9efc-10a7f1810b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.874124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1143/2284] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:43.886112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:43.887779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:43.900931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850908f-83e3-4b44-b58e-fced3e24c73a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:43.904511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:43.905141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:43.905428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:43.905704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:43.913935 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:43.915365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b052-264f-4994-a6b6-8ef60af17ea0 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:43.924291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1142/2285] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:44.004976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:44.005271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:44.005551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:44.007001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1144/2286] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:14:44.012255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:44.012553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:44.012830 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:44.032846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] MFA Rules not processed for user `34be797ec47b4d66aba7a9fa13419dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:44.034860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:44.046415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1143/2287] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:14:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:44.056851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:44.058557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:44.073195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb1d3e-0453-47d9-a9a9-3766582864a3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:44.077038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:44.077700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:44.077987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:44.078265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:44.089093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:44.090539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c18cde-fef6-45ff-9d92-aa3c92e2d928 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:44.101767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1145/2288] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:44.786647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:44.796131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11143c04-ac82-46c6-8905-9bfbd5f57e2a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:44.799608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:44.800273 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:44.800574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:44.800843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:44.802591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:44.815987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:44.817396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:44.828654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1144/2289] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:46.826754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:46.827234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:46.827334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:46.844485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:14:46.845662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:46.852618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1146/2290] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:14:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:14:46.864631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:46.876292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de864-6530-424f-9b47-972641c0acc5 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:46.881467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:46.882100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:46.882381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:46.882654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:46.890596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:46.892195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:46.900259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1145/2291] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:14:56.588620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:14:56.590089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:56.606000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6161da-99a6-4cdf-aff6-33410a80fbea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:14:56.611371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:14:56.612028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:14:56.612308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:14:56.612582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:14:56.614262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:14:56.678288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:14:56.679915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7f899-ffbd-47e4-a2aa-2bf8eba627ff service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:14:56.688978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1147/2292] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:14:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:14:56.896967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:02.681321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:15:02.683121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:02.695724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f87c5-cdcc-4e80-9a2b-f76e5a58809f service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:15:02.699375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:15:02.700053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:02.700336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:02.700609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:02.702583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:02.762610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:15:02.764152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:15:02.773969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1146/2293] 10.222.0.47 () {60 vars in 1396 bytes} [Wed Jun 29 16:15:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:15:06.684836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=72 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:12.768970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=28 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:17.045660 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:17.046084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:17.046214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:17.062886 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:15:17.064113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:17.071478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1148/2294] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:15:17.083911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:15:17.096011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc8941-f80e-41de-a117-122726223197 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:15:17.101519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:15:17.102151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:17.102429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:17.102708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:17.110739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:15:17.112659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29e82-4233-424a-964d-1675cb3ac0b3 service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:15:17.120816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1147/2295] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:15:27.058201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:27.117793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:38.753938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:15:38.763977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d415-740c-425c-a9a5-13814c911e95 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:15:38.767481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:15:38.768140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:38.768424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:38.768701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:38.770455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:38.779639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:15:38.781083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:15:38.788950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1149/2296] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:15:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:15:40.760987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:40.761496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:40.761601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:40.778668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] MFA Rules not processed for user `1c00db02926f4d849249c3990fdf8308`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:15:40.779875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:40.786581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1148/2297] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:15:46.826379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:15:46.841615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa9485-f8c3-4cce-9564-e06784f1e678 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:15:46.850196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:15:46.850924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:15:46.851211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:15:46.851492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:15:46.853400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:15:46.866581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:15:46.868264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:15:46.879138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1150/2298] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:15:50.773361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:15:56.874367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=12 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:00.029226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:00.030639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:00.046339 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a72a2-ee8d-4c88-aa26-e8a22c42d3de None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:00.051732 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:00.052436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:00.052723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:00.052996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:00.054750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:00.112940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:00.114528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdf0d-007a-419c-8e68-40056718d719 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:00.123523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1149/2299] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:16:10.119888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=28 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:10.622674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:10.634021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1e37-3ef1-4b4b-b029-a8884573b133 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:10.639506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:10.640195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:10.640478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:10.640754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:10.642541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:10.653080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:10.654653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:10.663652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1151/2300] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:16:20.659438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:24.522459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:24.523008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:24.523008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:24.540482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] MFA Rules not processed for user `2020c486ef3e4fceb1d671269668ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:16:24.541990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:24.549073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1150/2301] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:16:24.846954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:24.856642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5815-53e6-4188-811f-35b20165ffbe service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:24.860210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:24.860839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:24.861125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:24.861402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:24.863166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:24.873131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:24.874537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f49886-512a-40e4-9edc-b72219ebbb0e service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:24.882969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1152/2302] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:16:27.220788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:27.222226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:27.290748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1c898-9c8e-42c4-a164-285164f8b258 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:27.295754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:27.296428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:27.296710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:27.297015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:27.298807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:27.311055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:27.312674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:27.323962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1151/2303] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:16:33.338074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:33.339137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:33.339243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:33.357363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] MFA Rules not processed for user `d75d976f2c554209bc4c64d338ad7cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:16:33.358597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:33.365719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1153/2304] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:16:37.318532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=35 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:40.054636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:40.067538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c656c-d934-41c1-bdaa-351853e4a9f4 service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:40.072980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:40.078471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:40.078471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:40.078471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:40.078471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:40.091938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:40.093530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a2265-cdad-48d3-ad55-7326aae8a046 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:40.104321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1152/2305] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:16:43.351765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=9 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:45.904848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:16:45.917264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7e92c-1390-4d10-a485-a1ba48082fe8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:16:45.923310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:16:45.923988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:16:45.924269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:16:45.924562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:16:45.926310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:16:45.938808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:16:45.940415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:16:45.951882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1154/2306] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:16:50.099753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:16:55.946822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:11.118730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa03c-5227-402a-abe0-21ac4d9a7f90 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:11.119187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa03c-5227-402a-abe0-21ac4d9a7f90 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:11.119287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afa03c-5227-402a-abe0-21ac4d9a7f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:11.137773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c4afa03c-5227-402a-abe0-21ac4d9a7f90 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:11.139006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c4afa03c-5227-402a-abe0-21ac4d9a7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:11.146115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1153/2307] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:11.197093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:11.208161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd76a05-1102-490a-a88b-a3890a2e9f10 service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:11.213129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:11.213757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:11.214043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:11.214320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:11.222623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:11.224300 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e9a8b-4789-48c5-9bf9-37f194743cd0 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:11.232726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1155/2308] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:17:15.499703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fbee-e690-44ea-bda9-1fd40dddef13 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:15.500326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fbee-e690-44ea-bda9-1fd40dddef13 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:15.500326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fbee-e690-44ea-bda9-1fd40dddef13 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:15.501677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1154/2309] 10.222.0.47 () {54 vars in 921 bytes} [Wed Jun 29 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 16:17:15.511452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:15.511967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:15.512081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:15.558450 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] MFA Rules not processed for user `5a279f9aa024490fa421bb6fe5fd0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:15.559693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:15.568887 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1156/2310] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Jun 29 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:15.585629 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1fbee-e690-44ea-bda9-1fd40dddef13 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:15.604834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1fbee-e690-44ea-bda9-1fd40dddef13 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:15.610630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:15.611279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:15.611564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:15.611869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:15.620676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:15.622268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:15.632138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1155/2311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:15.896082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:15.910379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a927e24-c244-42ec-9bd1-828ee2555d3f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:15.914200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:15.914978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:15.915267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:15.915545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:15.917341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:15.985439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:15.986862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:15.996592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1157/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:19.604088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:19.620634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7404b-cfab-43a6-beb5-a121146a762f service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:19.635007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:19.636000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:19.636516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:19.637686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:19.641311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:19.656529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:19.659377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:19.677782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1156/2313] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:19.745581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:19.748349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:19.767793 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5b4-b849-4eb8-aa0c-27492f30ec73 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:19.774185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:19.775364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:19.775762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:19.776139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] PATH_INFO: `/v3/users/c7d0b7e3000444c1969640bfd27d72ba` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:19.777538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d0b7e3000444c1969640bfd27d72ba)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:19.779704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:19.844634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d0b7e3000444c1969640bfd27d72ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:19.855113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d0b7e3000444c1969640bfd27d72ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:19.855948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d0b7e3000444c1969640bfd27d72ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:19.856719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d0b7e3000444c1969640bfd27d72ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:19.864395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d0b7e3000444c1969640bfd27d72ba'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:19.885502 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1158/2314] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:19 2022] DELETE /identity/v3/users/c7d0b7e3000444c1969640bfd27d72ba => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:20.091784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.108642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0293a4-6c43-4a12-ac14-71ab14e2d90b service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.166662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.175260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.176171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.176459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.176741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] PATH_INFO: `/v3/projects/cbd79cd5dd034dec885a0a56cd16b993` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.177515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.177939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd79cd5dd034dec885a0a56cd16b993)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.179897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.193120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2367f28-5043-442c-85de-3f8184b99398 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.198019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.198893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.199174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.199449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] PATH_INFO: `/v3/users/1c00db02926f4d849249c3990fdf8308` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.200772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c00db02926f4d849249c3990fdf8308)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.202678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.229216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd79cd5dd034dec885a0a56cd16b993', 'request_id': 'req-de7f457b-1804-4ef2-8eca-4c7a71346858'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.232257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:20.237977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd79cd5dd034dec885a0a56cd16b993', 'request_id': 'req-de7f457b-1804-4ef2-8eca-4c7a71346858'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.244507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd79cd5dd034dec885a0a56cd16b993', 'request_id': 'req-de7f457b-1804-4ef2-8eca-4c7a71346858'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.254081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c00db02926f4d849249c3990fdf8308'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.261573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] The token cache is being invalidate because project cbd79cd5dd034dec885a0a56cd16b993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:20.261861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.262525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.263707 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c00db02926f4d849249c3990fdf8308'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.264193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1157/2315] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:20 2022] DELETE /identity/v3/projects/cbd79cd5dd034dec885a0a56cd16b993 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:20.267796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c00db02926f4d849249c3990fdf8308'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.267796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c00db02926f4d849249c3990fdf8308'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.268736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.270085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.272923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c00db02926f4d849249c3990fdf8308'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.290938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1159/2316] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:20 2022] DELETE /identity/v3/users/1c00db02926f4d849249c3990fdf8308 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:20.333213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:20.340147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f457b-1804-4ef2-8eca-4c7a71346858 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.400315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.401188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.401468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.401738 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] PATH_INFO: `/v3/users/859c4c23fa4c4c75bb5e297a227969ae` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.402926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859c4c23fa4c4c75bb5e297a227969ae)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.404931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.458985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859c4c23fa4c4c75bb5e297a227969ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.468406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859c4c23fa4c4c75bb5e297a227969ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.468406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859c4c23fa4c4c75bb5e297a227969ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.469825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.472438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.476505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859c4c23fa4c4c75bb5e297a227969ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.493423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3de8-42c0-4140-9810-445ff8630b60 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.494900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c17ec14-2e0f-4c1b-aa24-003eb4ba5443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859c4c23fa4c4c75bb5e297a227969ae'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.499056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.500397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.500678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.501036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] PATH_INFO: `/v3/projects/6a410f5a9cef44b39a657b28f6c1772b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.502168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a410f5a9cef44b39a657b28f6c1772b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.502910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1158/2317] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:20 2022] DELETE /identity/v3/users/859c4c23fa4c4c75bb5e297a227969ae => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:20.507010 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.557685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a410f5a9cef44b39a657b28f6c1772b', 'request_id': 'req-216ba754-31d1-4aac-9260-9ff75593417b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.565516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a410f5a9cef44b39a657b28f6c1772b', 'request_id': 'req-216ba754-31d1-4aac-9260-9ff75593417b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.571802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a410f5a9cef44b39a657b28f6c1772b', 'request_id': 'req-216ba754-31d1-4aac-9260-9ff75593417b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.582868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] The token cache is being invalidate because project 6a410f5a9cef44b39a657b28f6c1772b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:20.583156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.583833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-216ba754-31d1-4aac-9260-9ff75593417b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.585413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1160/2318] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:20 2022] DELETE /identity/v3/projects/6a410f5a9cef44b39a657b28f6c1772b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:20.590295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.590666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.591556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.610175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:20.611465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.678821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1159/2319] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:20.688227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.688569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.688795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.690037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.691556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.706315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff8a8-20c6-44c5-b6bb-909f32179d2e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.711336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.711511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:20.712329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.712605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.712768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.712877 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] PATH_INFO: `/v3/projects/ddbe4448c23c4277b32a95293e5ffedf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.714048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbe4448c23c4277b32a95293e5ffedf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.716146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.723134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1161/2320] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:20.727095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.736391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fa11d-b3a5-4c2b-8798-0eefac357f8c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.738486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:20.741322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.741968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.742250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.742543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.743258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:20.743621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.745357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.761940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1162/2321] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:17:20.763496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.772058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbe4448c23c4277b32a95293e5ffedf', 'request_id': 'req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.773314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c48ec-a7a4-44b9-b427-44e9efed8058 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.780139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbe4448c23c4277b32a95293e5ffedf', 'request_id': 'req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.786824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbe4448c23c4277b32a95293e5ffedf', 'request_id': 'req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.797903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] The token cache is being invalidate because project ddbe4448c23c4277b32a95293e5ffedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:20.798187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.798853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a3eff2f7-99d7-49ab-91fb-24e7547e7d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:20.800753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1160/2322] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:20 2022] DELETE /identity/v3/projects/ddbe4448c23c4277b32a95293e5ffedf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:20.805690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606cab2-d192-4661-8ee5-b01d1435b397 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.805821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606cab2-d192-4661-8ee5-b01d1435b397 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.806131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606cab2-d192-4661-8ee5-b01d1435b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.826345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7606cab2-d192-4661-8ee5-b01d1435b397 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:20.827558 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7606cab2-d192-4661-8ee5-b01d1435b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.834678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.835332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.835613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.835912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.836656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.838530 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.851639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:20.876767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1163/2323] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:20.881320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.883160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.889194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1161/2324] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:20.896854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.897146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.897423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.914949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:20.916203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:20.955358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dce08-6068-4d9c-a738-a76b05893e3a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:20.960172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:20.960842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:20.961122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:20.961398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:20.962095 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:20.964024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:20.979249 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1162/2325] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:20.984293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.990432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1164/2326] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:20 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:20.991409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:20.995644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf606f-8f76-44b1-bdda-32455ec4e482 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.000984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.001589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e483dd-bbe6-4fd5-a931-0588b26e5b98 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.001721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.001898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.002226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.002890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:21.003194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.004824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.006625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.007356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.007647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.008209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.008938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.010608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.017360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1163/2327] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:17:21.023796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1165/2328] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:17:21.023963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.025115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.031331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7a31-13c0-41a4-9848-6432117ea81b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.034486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303951d-0655-4384-9aac-fc6ac559b3af admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.036033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.036666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.036951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.037228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.037902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.039787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.040155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.040786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.041075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.041355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.042075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.043645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.055381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1166/2329] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:17:21.059550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.071749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5623-f7b2-4451-8b7d-6bc35ad188a7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.071980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1164/2330] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:21.075817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.091599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:21.144726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.145702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.146055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.146404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] PATH_INFO: `/v3/projects/20ba04e1dfa4468eb5e135729d377840/users/366976830b2349818cfc17730efebd1d/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.151467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c93a-3b04-4073-8d10-435d7163a904 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.156289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.156958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.157235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.157508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.158184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.160126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.163361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ba04e1dfa4468eb5e135729d377840, user_id=366976830b2349818cfc17730efebd1d, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.166791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969ebd8-6ab5-44d9-b773-341af00b5dc0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.182867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1165/2331] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:21.187557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.188081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1167/2332] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:21 2022] PUT /identity/v3/projects/20ba04e1dfa4468eb5e135729d377840/users/366976830b2349818cfc17730efebd1d/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:21.198281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.198281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.198281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.202504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dffd36-2d90-4c4c-aba8-8d108d42137f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.224062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] MFA Rules not processed for user `366976830b2349818cfc17730efebd1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:21.225266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:21.251949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:21.264537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.265211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.265497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.265773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.266508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.268449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.279860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1166/2333] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:17:21.283054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.293299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d89d7-dd86-413f-9318-ca1036a31e8a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.293473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1168/2334] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:21.298081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.299318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.300008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.300288 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.300594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.301309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.302902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.308563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011e4b7-9e3e-41d6-970d-55cb85b232b5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.316217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1167/2335] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:17:21.316382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.316382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.316382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.316382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.316744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.317142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.317853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.327593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac816e75-1251-41cd-a6e2-013afde3de54 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.332348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.333212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.333494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.333775 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] PATH_INFO: `/v3/projects/8c561382be984c2b9c1285c6e5b6268a/users/da01cd253f6e4bc792868f337ff85b0a/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.346006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1169/2336] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:21.347308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.349165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c561382be984c2b9c1285c6e5b6268a, user_id=da01cd253f6e4bc792868f337ff85b0a, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.351811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a28ed-93af-4a91-b289-74d14bae604b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.366140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1168/2337] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:21 2022] PUT /identity/v3/projects/8c561382be984c2b9c1285c6e5b6268a/users/da01cd253f6e4bc792868f337ff85b0a/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:21.371020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.371315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.371596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.388266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:21.389467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:21.414151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697941-fbce-48d8-a6ab-653642471d04 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.449380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1169/2338] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:21.458967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.460356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:21.466808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:21.470921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.471589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.471904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.472206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.472921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.474845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.498289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1170/2339] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:21.499947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.510143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83982433-1ce7-4650-affe-d3f10f7115b8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.515601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.516303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.516590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.516867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.517589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.519164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.520438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0ca09-935a-4032-a647-e1cc66495e68 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.524054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.524689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.524966 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.525237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.529828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1171/2340] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:21.533892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.535582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.537074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.543115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7144f88-3e30-47bb-850c-517781466cfc admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.547149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1170/2341] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:17:21.548601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.549452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.549736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.550009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] PATH_INFO: `/v3/projects/2832ac245768494fb3c8061efba544d3/users/c38f30a391b34d31999ed09c6f6987a6/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.564721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2832ac245768494fb3c8061efba544d3, user_id=c38f30a391b34d31999ed09c6f6987a6, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.567335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.580307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1172/2342] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:21 2022] PUT /identity/v3/projects/2832ac245768494fb3c8061efba544d3/users/c38f30a391b34d31999ed09c6f6987a6/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:21.584398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.595183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c58834-da70-443a-8825-e414df3e0068 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.661385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.662177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.662408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.662680 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.663471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.665359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e7f15-6e40-4121-83b9-2b9d215db3fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.675686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1171/2343] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:21.679925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.686961 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:21.691805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427da3-14ef-4ad9-9499-cd0a170630ef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.698270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.699338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.699720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.700112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] PATH_INFO: `/v3/projects/2832ac245768494fb3c8061efba544d3/users/c38f30a391b34d31999ed09c6f6987a6/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.702945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2832ac245768494fb3c8061efba544d3, user_id=c38f30a391b34d31999ed09c6f6987a6, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.706068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.717536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1173/2344] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:21 2022] PUT /identity/v3/projects/2832ac245768494fb3c8061efba544d3/users/c38f30a391b34d31999ed09c6f6987a6/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:21.727945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.728267 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.728548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.755180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] MFA Rules not processed for user `c38f30a391b34d31999ed09c6f6987a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:21.756440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:21.834836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1172/2345] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:21.846709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:21.848429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:21.924291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aad35-2653-4c70-abe7-e57536c044b8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:21.928867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:21.929522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:21.929810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:21.930076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:21.940826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:21.942929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c79c-4a64-4bb2-9956-c688c8d6cbde service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:21.954967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1174/2346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:22.030062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:22.048304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a948cc-e67f-47ff-b02e-43078dc2bcee None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:22.051974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:22.052647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:22.052925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:22.053197 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:22.082824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:22.115076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:22.116589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:22.126569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1173/2347] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:25.811232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:25.811782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:25.811782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:25.853611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] MFA Rules not processed for user `da01cd253f6e4bc792868f337ff85b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:25.854826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:25.928655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1175/2348] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:25.929800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:25.995518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75638c-255a-43c4-ae88-3a75f8c20d26 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.000637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.001302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.001591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.001989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.002697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.004665 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.031568 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1174/2349] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:25 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:26.035496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:26.046882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bb6d6-bc3d-4422-bd3e-ae3cf5d695ff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.108458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.109139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.109426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.109705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.110410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.112366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.136270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1176/2350] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:26 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:26.137539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:26.148443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8b603-8595-4023-97c7-6b04ecc73552 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.153044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.153752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.154036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.154328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.155074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.156718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.168086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1175/2351] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:26.172979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:26.183081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a562-a35d-4012-9e96-e0ba8fe9fb70 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.188507 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.189397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.189678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.189953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] PATH_INFO: `/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863/users/b474c7eaab2749a4a364fea9c6fb4ef9/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.202652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:26.207129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f7a2e88c03444bb0c91b0b98c1d863, user_id=b474c7eaab2749a4a364fea9c6fb4ef9, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.210414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.225833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1177/2352] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:26 2022] PUT /identity/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863/users/b474c7eaab2749a4a364fea9c6fb4ef9/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:26.229876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:26.241114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eae45-7bfd-44c6-97d5-a50a0d07295a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.300806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.301422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.301722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.302005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.302729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.304439 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7bbf-65dc-41ed-afe5-4239d7d537f6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.315541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1176/2353] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:26.319738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:26.329901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d28c0-0dff-451a-ba73-66ecde7be25f admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:26.334420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:26.335283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:26.335561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:26.335868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] PATH_INFO: `/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863/users/b474c7eaab2749a4a364fea9c6fb4ef9/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:26.337862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f7a2e88c03444bb0c91b0b98c1d863, user_id=b474c7eaab2749a4a364fea9c6fb4ef9, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:26.340521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:26.350835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1178/2354] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:26 2022] PUT /identity/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863/users/b474c7eaab2749a4a364fea9c6fb4ef9/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:31.009672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:31.010174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:31.010447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:31.040471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] MFA Rules not processed for user `b474c7eaab2749a4a364fea9c6fb4ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:31.042083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:31.073373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:31.130604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1177/2355] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:31.145678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:31.147676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:31.253460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761218-fe14-436a-b1e2-56a2dbe2fc0b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:31.270942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:31.272756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:31.272756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:31.272756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:31.361645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:31.363318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c47632-a14d-4f7f-972e-b068d67e354a service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:31.373373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1179/2356] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:34.309045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:34.397913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc79b-8ec6-4406-a37c-baadf9c517a7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:34.403092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:34.404658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:34.404941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:34.405223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] PATH_INFO: `/v3/users/366976830b2349818cfc17730efebd1d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:34.406456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366976830b2349818cfc17730efebd1d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:34.408810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:34.464544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366976830b2349818cfc17730efebd1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:34.474011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366976830b2349818cfc17730efebd1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:34.474884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366976830b2349818cfc17730efebd1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:34.485377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366976830b2349818cfc17730efebd1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:34.497512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366976830b2349818cfc17730efebd1d'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:34.504085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1178/2357] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:34 2022] DELETE /identity/v3/users/366976830b2349818cfc17730efebd1d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:34.508861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:34.509392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:34.509494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:34.531621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:34.533489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:34.692021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1180/2358] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:34.701519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:34.704535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:34.783964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:34.827995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03a10e-b9d2-45a6-88fe-1e81cd500f67 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:34.832052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:34.832725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:34.833013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:34.833293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:34.849165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:34.850927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:34.864890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1179/2359] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:35.255969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:35.257432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:35.280413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a9f8e-cef4-49f1-b421-efa08808db49 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:35.295670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:35.296832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:35.297643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:35.298357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] PATH_INFO: `/v3/projects/20ba04e1dfa4468eb5e135729d377840` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:35.301065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ba04e1dfa4468eb5e135729d377840)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:35.303361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:35.314857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:35.369134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ba04e1dfa4468eb5e135729d377840', 'request_id': 'req-85240170-d598-4c88-81ba-1a82d5612d2e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.379760 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ba04e1dfa4468eb5e135729d377840', 'request_id': 'req-85240170-d598-4c88-81ba-1a82d5612d2e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.387072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ba04e1dfa4468eb5e135729d377840', 'request_id': 'req-85240170-d598-4c88-81ba-1a82d5612d2e'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.399148 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] The token cache is being invalidate because project 20ba04e1dfa4468eb5e135729d377840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:35.399573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.400269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.402546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1181/2360] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:35 2022] DELETE /identity/v3/projects/20ba04e1dfa4468eb5e135729d377840 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:35.406359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:35.419802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619934-da2d-47fb-ad1a-a912c3baa358 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:35.493136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:35.494023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:35.494360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:35.494640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] PATH_INFO: `/v3/users/c38f30a391b34d31999ed09c6f6987a6` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:35.496189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38f30a391b34d31999ed09c6f6987a6)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:35.498156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:35.579438 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38f30a391b34d31999ed09c6f6987a6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.597858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38f30a391b34d31999ed09c6f6987a6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.599441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38f30a391b34d31999ed09c6f6987a6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.612852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38f30a391b34d31999ed09c6f6987a6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.629021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0bfc8e4-5e81-4045-b275-5213f7c5fb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38f30a391b34d31999ed09c6f6987a6'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:35.635735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1180/2361] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:35 2022] DELETE /identity/v3/users/c38f30a391b34d31999ed09c6f6987a6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:36.094073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.095907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:36.110765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85240170-d598-4c88-81ba-1a82d5612d2e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.188397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.189380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.189737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.190025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] PATH_INFO: `/v3/projects/2832ac245768494fb3c8061efba544d3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.191246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2832ac245768494fb3c8061efba544d3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.193197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.249631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2832ac245768494fb3c8061efba544d3', 'request_id': 'req-218892d7-b460-4d3a-913c-b07c55a13bf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:36.258276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2832ac245768494fb3c8061efba544d3', 'request_id': 'req-218892d7-b460-4d3a-913c-b07c55a13bf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:36.266715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2832ac245768494fb3c8061efba544d3', 'request_id': 'req-218892d7-b460-4d3a-913c-b07c55a13bf4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:36.279711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] The token cache is being invalidate because project 2832ac245768494fb3c8061efba544d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:36.280286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:36.281369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-218892d7-b460-4d3a-913c-b07c55a13bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:36.283117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1182/2362] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:36 2022] DELETE /identity/v3/projects/2832ac245768494fb3c8061efba544d3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:36.288187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.288512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.288794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.312294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:36.314030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:36.424916 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1181/2363] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:36.433122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.433416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.433700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.455288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:36.456580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:36.468857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1183/2364] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:36.473316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.479523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:36.483560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d4e5-8779-4ff4-9bbe-953656ff7e85 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.491989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.492807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.493233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.493523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.494527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:36.495116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.497012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.510158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1182/2365] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:17:36.515248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.524725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aaa6b-0949-45ba-96a2-88aeff4e4c70 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.529522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.530177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.530461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.530736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.531431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.533360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.553478 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:36.566816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1184/2366] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:36.568619 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.580381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142f5f-fef1-4a01-8f6a-6f9d3ab1cf10 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.655975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.656681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.656973 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.657237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.657929 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.660219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.681442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1183/2367] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:36.686032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.696215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc7f6-503d-41ba-a74d-2b5bb4fb757a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.700799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.701455 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.701733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.702007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.702730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.704347 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.715311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1185/2368] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:36.719285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.729365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646631-0b8b-4183-8ba5-30f5727ffb46 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.734641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.735297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.735566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.736008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.736585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.738187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735923d-f20e-48b6-8b39-4ee558e4841c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.750131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1184/2369] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:36.754574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.765543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd46323-bc51-4109-b6d3-f999de256021 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:36.770153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:36.771037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.771316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.771590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] PATH_INFO: `/v3/projects/bd6ebd506529472da0a55c256c1a2370/users/749f53d76700472b809b59b32342975c/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.786370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6ebd506529472da0a55c256c1a2370, user_id=749f53d76700472b809b59b32342975c, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:36.789082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:36.805419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1186/2370] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:36 2022] PUT /identity/v3/projects/bd6ebd506529472da0a55c256c1a2370/users/749f53d76700472b809b59b32342975c/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:36.816186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:36.816615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:36.816959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:36.846914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] MFA Rules not processed for user `749f53d76700472b809b59b32342975c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:36.848108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:36.927810 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1185/2371] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:36.933506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:36.996696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f340b0-4d5c-47f6-9b72-c63ed50c9fc8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.001688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.002424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.002778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.003120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.003952 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.005882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.037111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1187/2372] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:36 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:37.039179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.053468 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbf0af-eccf-46d8-bdf3-fc4f27fd374c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.157740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.158649 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.159039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.159418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.160386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.162460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3719c0-f649-414c-8349-c986a88c9b99 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.170188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:37.189272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1186/2373] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:37 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:37.194039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.205225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ca46b-d372-4b0d-ba84-ef4242397d0c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.212468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.213294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.213606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.214007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.214842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.217274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.227964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.228384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.228685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.231226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1188/2374] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:37.236028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.247344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8515f2-72e9-4607-997d-b5b2a91119b8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.252414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.252670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] MFA Rules not processed for user `5b45e8b15637406eb145ca6e756e1f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:37.253739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.254233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:37.254468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.254945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] PATH_INFO: `/v3/projects/79a3a09a07d44e5e9d15138a8205e525/users/5ee5501aa0f546188a833b6520b70bbe/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.272597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a3a09a07d44e5e9d15138a8205e525, user_id=5ee5501aa0f546188a833b6520b70bbe, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.275358 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.290612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1189/2375] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:37 2022] PUT /identity/v3/projects/79a3a09a07d44e5e9d15138a8205e525/users/5ee5501aa0f546188a833b6520b70bbe/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:37.295156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.321670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1187/2376] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:37.360140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437035-8909-4b00-ad17-29867706c83e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.364894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.365561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.365851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.366127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.366857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.368612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3b733-c3de-4a25-a70a-c0f634b0a315 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.381056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1190/2377] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:37.391854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.415011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaf049-9192-4101-a9ab-d36417718e9d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.419872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.420763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.421050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.421328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] PATH_INFO: `/v3/projects/79a3a09a07d44e5e9d15138a8205e525/users/5ee5501aa0f546188a833b6520b70bbe/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.423345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a3a09a07d44e5e9d15138a8205e525, user_id=5ee5501aa0f546188a833b6520b70bbe, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.426270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.439250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1188/2378] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:37 2022] PUT /identity/v3/projects/79a3a09a07d44e5e9d15138a8205e525/users/5ee5501aa0f546188a833b6520b70bbe/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:37.450857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.451211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.451552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.470094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:37.479730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] MFA Rules not processed for user `5ee5501aa0f546188a833b6520b70bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:37.481423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:37.554496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1191/2379] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:37.562000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.563840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:37.622566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f8286-d801-48d1-b2d0-4db46521c614 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.626205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.626918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.627255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.627615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.642044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.643884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:37.647513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.649756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.661896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1189/2380] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:37.703987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9782f-d9f5-46fc-a7c2-76eb54c41fa5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.707737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.708418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.708705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.708983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.711104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:37.721770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.723275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.735109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1192/2381] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:17:37.769344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:37.784858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80f9ff-9062-4a09-9fbf-95b6c9326754 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:37.796164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:37.797389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:37.797924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:37.798428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:37.866581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:37.868061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bb099-6a60-4e0f-9058-265f7c93c14a service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:37.878078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1190/2382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:40.518762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:40.583637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cc681-5557-454f-b7d7-a67e70677c46 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:40.588364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:40.589243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:40.589527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:40.589878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] PATH_INFO: `/v3/users/749f53d76700472b809b59b32342975c` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:40.591139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749f53d76700472b809b59b32342975c)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:40.593134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:40.635728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:40.642841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749f53d76700472b809b59b32342975c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:40.656410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749f53d76700472b809b59b32342975c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:40.657142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749f53d76700472b809b59b32342975c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:40.657971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749f53d76700472b809b59b32342975c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:40.669004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749f53d76700472b809b59b32342975c'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:40.701506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1193/2383] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:40 2022] DELETE /identity/v3/users/749f53d76700472b809b59b32342975c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:40.703263 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:40.703739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:40.704025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:40.731106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:40.733172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:40.766563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:40.826978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1191/2384] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:40.837622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:40.839168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:40.920427 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a90c-96b0-4387-8509-cd9cb22466d0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:40.925314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:40.925994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:40.926354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:40.926666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:40.954093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:40.956233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:40.980466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1194/2385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:41.290330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:41.292793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:41.307411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd341e-589a-42ae-b56c-0120fb35599a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:41.314686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:41.315798 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:41.316243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:41.316583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] PATH_INFO: `/v3/projects/bd6ebd506529472da0a55c256c1a2370` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:41.318806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6ebd506529472da0a55c256c1a2370)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:41.321423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:41.374835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6ebd506529472da0a55c256c1a2370', 'request_id': 'req-fd45dfb0-0f55-47b2-90da-0ba451110590'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.383440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6ebd506529472da0a55c256c1a2370', 'request_id': 'req-fd45dfb0-0f55-47b2-90da-0ba451110590'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.390147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6ebd506529472da0a55c256c1a2370', 'request_id': 'req-fd45dfb0-0f55-47b2-90da-0ba451110590'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.400796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] The token cache is being invalidate because project bd6ebd506529472da0a55c256c1a2370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:41.401090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.401750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.403299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1192/2386] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:41 2022] DELETE /identity/v3/projects/bd6ebd506529472da0a55c256c1a2370 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:41.407474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:41.418570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330435fc-380a-4eb6-be48-89e615f8b8a3 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:41.483404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:41.484350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:41.484631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:41.484909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] PATH_INFO: `/v3/users/5ee5501aa0f546188a833b6520b70bbe` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:41.486153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee5501aa0f546188a833b6520b70bbe)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:41.488140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:41.540755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee5501aa0f546188a833b6520b70bbe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.549207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee5501aa0f546188a833b6520b70bbe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.549968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee5501aa0f546188a833b6520b70bbe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.550603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee5501aa0f546188a833b6520b70bbe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.555944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:41.558178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4d4b479-ef82-4220-91cf-9df604bab4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee5501aa0f546188a833b6520b70bbe'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.583907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1195/2387] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:41 2022] DELETE /identity/v3/users/5ee5501aa0f546188a833b6520b70bbe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:41.856245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:41.858359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:41.873139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45dfb0-0f55-47b2-90da-0ba451110590 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:41.930154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:41.931219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:41.931545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:41.931912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] PATH_INFO: `/v3/projects/79a3a09a07d44e5e9d15138a8205e525` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:41.933168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a3a09a07d44e5e9d15138a8205e525)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:41.935204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:41.980302 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:41.981566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a3a09a07d44e5e9d15138a8205e525', 'request_id': 'req-0da8af81-ca6a-4260-96c1-2bd1c970752b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.989948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a3a09a07d44e5e9d15138a8205e525', 'request_id': 'req-0da8af81-ca6a-4260-96c1-2bd1c970752b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:41.997435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a3a09a07d44e5e9d15138a8205e525', 'request_id': 'req-0da8af81-ca6a-4260-96c1-2bd1c970752b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:42.009792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] The token cache is being invalidate because project 79a3a09a07d44e5e9d15138a8205e525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:42.010098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:42.010756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-0da8af81-ca6a-4260-96c1-2bd1c970752b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:42.012308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1193/2388] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:41 2022] DELETE /identity/v3/projects/79a3a09a07d44e5e9d15138a8205e525 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:42.017587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.017882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.018166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.036832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:42.038172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:42.108323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1196/2389] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:42.116017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.116305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.116579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.134524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:42.135710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:42.144508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1194/2390] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:42.148668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.159085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc6edb-c3e8-4965-85f1-1fdcca9035e3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.163737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.164415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.164704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.164984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.165748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:42.166057 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.167655 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.178985 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1197/2391] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:17:42.182850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.191895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33c33b-f03c-4837-8f29-4ad220cda0ce None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.196556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.197181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.197457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.197727 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.198399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.200864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.226139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1195/2392] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:42.230379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.240556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048371-cb0d-446d-b215-f36018402f9b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.295630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.296263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.296548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.296823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.297510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.299403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.318983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1198/2393] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:42.322967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.334027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc3f83-0695-4166-8b74-3c4141e7640c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.338697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.339346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.339650 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.339959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.340718 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.342318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.353885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1196/2394] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:42.357665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.368642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed598-c333-4239-9514-4a98edbd0087 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.374158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.374834 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.375142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.375447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.376341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.377821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578b6d-e027-4b4f-b80a-6e99eb052d23 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.391473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1199/2395] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:42.395644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.405599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e36d8-feb8-4b8b-a1af-9cda6c4cb4cd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.410316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.411184 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.411464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.411737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] PATH_INFO: `/v3/projects/8cd1f39b7a234939861988cfa633f463/users/17aecd1f10534d4894c2e91c6c6cc4fe/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.425883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd1f39b7a234939861988cfa633f463, user_id=17aecd1f10534d4894c2e91c6c6cc4fe, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.428584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.441627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1197/2396] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:42 2022] PUT /identity/v3/projects/8cd1f39b7a234939861988cfa633f463/users/17aecd1f10534d4894c2e91c6c6cc4fe/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:42.452429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.452718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.452990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.478624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] MFA Rules not processed for user `17aecd1f10534d4894c2e91c6c6cc4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:42.479854 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:42.510743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:42.545015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1200/2397] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:17:42.549747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.610707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714e1b-cd88-441b-93ac-01d12fbb1394 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.618518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893096-d055-494f-9110-df968f896a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.619370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893096-d055-494f-9110-df968f896a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.619653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893096-d055-494f-9110-df968f896a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.619959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893096-d055-494f-9110-df968f896a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.620761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893096-d055-494f-9110-df968f896a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.624356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893096-d055-494f-9110-df968f896a86 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.656587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1198/2398] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:42.660544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.673638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc015c7-d655-480b-bb35-eb03676e1141 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.735897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.736577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.736863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.737143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.737846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.739763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.760711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1201/2399] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:42.764930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893096-d055-494f-9110-df968f896a86 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.775055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893096-d055-494f-9110-df968f896a86 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.779605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.780289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.780569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.780842 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.781554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.783178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.793556 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1199/2400] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:42.798072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.808042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1f11-c0a8-439f-97ed-c4c063546d0b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.813127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.814012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.814278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.814554 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] PATH_INFO: `/v3/projects/c7da77a44d144fb6a23a2931560973c2/users/be35aab4514843a5900202396c8f0947/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.829412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7da77a44d144fb6a23a2931560973c2, user_id=be35aab4514843a5900202396c8f0947, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.832338 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.845227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1202/2401] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:42 2022] PUT /identity/v3/projects/c7da77a44d144fb6a23a2931560973c2/users/be35aab4514843a5900202396c8f0947/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:42.849142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.859181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac172fea-bc2a-4dc8-a2ff-05dc5cfe78c0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.907336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:42.922148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.922820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.923105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.923380 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.924154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.925807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237a4c3-e42d-46c6-b30b-33646429e5fe admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.936431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1200/2402] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:42.940626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:42.951703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11226eb7-3d03-471a-b9f9-3c31a77ea33e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:42.958090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:42.959311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.959595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.959904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] PATH_INFO: `/v3/projects/c7da77a44d144fb6a23a2931560973c2/users/be35aab4514843a5900202396c8f0947/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:42.961962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7da77a44d144fb6a23a2931560973c2, user_id=be35aab4514843a5900202396c8f0947, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:42.964637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:42.975607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1203/2403] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:42 2022] PUT /identity/v3/projects/c7da77a44d144fb6a23a2931560973c2/users/be35aab4514843a5900202396c8f0947/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:42.986709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:42.986998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:42.987276 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:43.013994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] MFA Rules not processed for user `be35aab4514843a5900202396c8f0947`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:43.015191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:43.092069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1201/2404] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:43.102861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:43.104862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:43.173442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3061-355c-478c-83d2-e7f592cac43e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:43.177134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:43.177780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:43.178064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:43.178340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:43.187807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:43.189254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fe5be-8b06-4ef5-a021-b58bb8c29504 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:43.198611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1204/2405] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:43.733614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:43.798497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dff207-69d0-4fe0-92b1-e1e459110233 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:43.804134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:43.805085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:43.805440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:43.805816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] PATH_INFO: `/v3/users/17aecd1f10534d4894c2e91c6c6cc4fe` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:43.807099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17aecd1f10534d4894c2e91c6c6cc4fe)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:43.809282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:43.865753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17aecd1f10534d4894c2e91c6c6cc4fe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:43.874336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17aecd1f10534d4894c2e91c6c6cc4fe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:43.875865 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17aecd1f10534d4894c2e91c6c6cc4fe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:43.883010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17aecd1f10534d4894c2e91c6c6cc4fe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:43.890172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:43.906147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17aecd1f10534d4894c2e91c6c6cc4fe'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:43.916039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1202/2406] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:43 2022] DELETE /identity/v3/users/17aecd1f10534d4894c2e91c6c6cc4fe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:43.917870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:43.918565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:43.918565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:43.948537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:43.950071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:43.978867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:44.014678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1205/2407] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:44.024112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:44.025496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:44.082356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24104f54-85a7-4fed-a6d3-cba3f483fbe9 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:44.086055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:44.086696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:44.086978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:44.087252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:44.097012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:44.098450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:44.108508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1203/2408] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:44.386382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:44.388717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:44.401447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff9901-8272-4fb1-aee9-74ede28c0f00 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:44.407048 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:44.408081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:44.408436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:44.408872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] PATH_INFO: `/v3/projects/8cd1f39b7a234939861988cfa633f463` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:44.410073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd1f39b7a234939861988cfa633f463)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:44.412112 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:44.469538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd1f39b7a234939861988cfa633f463', 'request_id': 'req-ed5c988c-a73f-4295-a7f9-aee6fcfab300'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.479600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd1f39b7a234939861988cfa633f463', 'request_id': 'req-ed5c988c-a73f-4295-a7f9-aee6fcfab300'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.487159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd1f39b7a234939861988cfa633f463', 'request_id': 'req-ed5c988c-a73f-4295-a7f9-aee6fcfab300'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.502028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] The token cache is being invalidate because project 8cd1f39b7a234939861988cfa633f463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:44.502321 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.503169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.505151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1206/2409] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:44 2022] DELETE /identity/v3/projects/8cd1f39b7a234939861988cfa633f463 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:44.509129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:44.521892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf5c5-2572-4021-9688-b420d4e71112 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:44.594683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:44.596473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:44.596473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:44.596692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] PATH_INFO: `/v3/users/be35aab4514843a5900202396c8f0947` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:44.598534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be35aab4514843a5900202396c8f0947)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:44.600270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:44.661349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be35aab4514843a5900202396c8f0947'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.669676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be35aab4514843a5900202396c8f0947'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.670330 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be35aab4514843a5900202396c8f0947'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.677433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be35aab4514843a5900202396c8f0947'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.690015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-630cd139-a654-46d8-a225-ccc2dc5f7bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be35aab4514843a5900202396c8f0947'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:44.696181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1204/2410] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:44 2022] DELETE /identity/v3/users/be35aab4514843a5900202396c8f0947 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:44.969670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:44.971127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:44.985623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c988c-a73f-4295-a7f9-aee6fcfab300 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.045083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.045957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.046237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.046511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] PATH_INFO: `/v3/projects/c7da77a44d144fb6a23a2931560973c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.047719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7da77a44d144fb6a23a2931560973c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.049720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.102829 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7da77a44d144fb6a23a2931560973c2', 'request_id': 'req-a65a811e-27c8-4b27-aed3-7cc8535d079d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.106529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:45.111674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7da77a44d144fb6a23a2931560973c2', 'request_id': 'req-a65a811e-27c8-4b27-aed3-7cc8535d079d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.120460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7da77a44d144fb6a23a2931560973c2', 'request_id': 'req-a65a811e-27c8-4b27-aed3-7cc8535d079d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.131702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] The token cache is being invalidate because project c7da77a44d144fb6a23a2931560973c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:45.132045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.132804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a65a811e-27c8-4b27-aed3-7cc8535d079d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.134617 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1207/2411] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:44 2022] DELETE /identity/v3/projects/c7da77a44d144fb6a23a2931560973c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:45.140572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.141046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.141141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.158535 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:45.159748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:45.164469 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:45.229700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1205/2412] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:45.238020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.238313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.238597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.256373 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:45.257580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:45.265848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1208/2413] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:45.269725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.279943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3ef0-f487-48e0-83c5-19f8d43a83f2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.284538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.285185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.285471 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.285750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.286478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:45.286788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.288427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.300321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1206/2414] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:17:45.304328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.314113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9080f5-2c4f-45c7-b1f0-1130c01623b9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.318689 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.319326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.319606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.319908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.320626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.322505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.350583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1209/2415] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:45.351710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.362349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c3107-5715-4f71-8530-e5674d0b62ad admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.417279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.417868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.418150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.418423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.419093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.421621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.441531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1207/2416] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:45.445619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.455722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5636d-57af-4bd9-bb01-cb8ed9cecfb8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.460299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.460941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.461221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.461495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.462209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.463817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.475416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1210/2417] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:45.479333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.489747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f549e-2d36-416f-a20a-cccb84153e39 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.494366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.495007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.495290 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.495566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.496318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.497901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf42cb-1b09-419e-82c8-564099f4a770 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.507613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1208/2418] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:45.511695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.521325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b765-ad0f-4ad6-885f-5ee9f36fbef9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.525868 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.526722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.526996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.527265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] PATH_INFO: `/v3/projects/7953bc7ebc7d40e2b735ce43c6a6f3c2/users/272819f39e5343c2aef88fe1d5052b9e/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.542412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7953bc7ebc7d40e2b735ce43c6a6f3c2, user_id=272819f39e5343c2aef88fe1d5052b9e, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.545650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.558604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1211/2419] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:45 2022] PUT /identity/v3/projects/7953bc7ebc7d40e2b735ce43c6a6f3c2/users/272819f39e5343c2aef88fe1d5052b9e/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:17:45.568726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.569019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.569294 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.595636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] MFA Rules not processed for user `272819f39e5343c2aef88fe1d5052b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:45.596874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:45.660963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1209/2420] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:45.672271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.673879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:45.731926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9853c-79cd-4924-8d0d-93250e62cea3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.736003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.736649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.737004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.737285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.745865 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.747287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5591-b873-4f49-87dd-1de65efcda66 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.756712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1212/2421] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:45.776220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:45.782270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:45.846213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f184a0d-6d07-467d-9ee8-61e5df0c0b92 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:45.850993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:45.852108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.852442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.852789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] PATH_INFO: `/v3/users/272819f39e5343c2aef88fe1d5052b9e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.854075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=272819f39e5343c2aef88fe1d5052b9e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:45.856182 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:45.914880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272819f39e5343c2aef88fe1d5052b9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.923640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272819f39e5343c2aef88fe1d5052b9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.924803 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272819f39e5343c2aef88fe1d5052b9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.935250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272819f39e5343c2aef88fe1d5052b9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.951616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272819f39e5343c2aef88fe1d5052b9e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:45.958234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1210/2422] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:17:45 2022] DELETE /identity/v3/users/272819f39e5343c2aef88fe1d5052b9e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:45.962988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:45.963281 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:45.963615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:45.981189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:45.982575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:46.045090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1213/2423] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:46.054847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.056370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:46.118681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaac75-715b-4945-99ba-474b7fa4eaba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.122922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.123563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.123872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.124149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.133440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.135141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698c838-c697-4123-b7ab-2d83323c7224 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.145378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1211/2424] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:46.474964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.476463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:46.489390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694c86-038c-4ec1-a2c3-1daff7ef18ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.494007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.494873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.495154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.495420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] PATH_INFO: `/v3/projects/7953bc7ebc7d40e2b735ce43c6a6f3c2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.496681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7953bc7ebc7d40e2b735ce43c6a6f3c2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.499189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.516770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:46.547209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7953bc7ebc7d40e2b735ce43c6a6f3c2', 'request_id': 'req-16d3ff0d-e06a-471e-8653-e3e7e421469d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:46.554688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7953bc7ebc7d40e2b735ce43c6a6f3c2', 'request_id': 'req-16d3ff0d-e06a-471e-8653-e3e7e421469d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:46.561630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7953bc7ebc7d40e2b735ce43c6a6f3c2', 'request_id': 'req-16d3ff0d-e06a-471e-8653-e3e7e421469d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:46.571902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] The token cache is being invalidate because project 7953bc7ebc7d40e2b735ce43c6a6f3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:17:46.572188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:46.572805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-16d3ff0d-e06a-471e-8653-e3e7e421469d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:17:46.574308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1214/2425] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:17:46 2022] DELETE /identity/v3/projects/7953bc7ebc7d40e2b735ce43c6a6f3c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:46.579130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.579419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.579691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.596643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:46.598244 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:46.618776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:46.660823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1212/2426] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:46.670125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.670434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.670714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.689737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:46.691060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:46.698803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1215/2427] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:46.702907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.712494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40056667-b783-426f-9ba7-09d98492f5ef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.717580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.718278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.718507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.718778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.719498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:17:46.719802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.721414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.733552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1213/2428] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:17:46.737684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.747565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb071ccb-7da0-4635-a0a0-716270359426 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.752280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.753185 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.753473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.753770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.754472 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.756365 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.782116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1216/2429] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:17:46 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:17:46.786166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.796678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5242e1-9051-4afb-a10e-e886205e2932 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.852487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.853147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.853430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.853707 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.854395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.856341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.875381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1214/2430] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:17:46 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:17:46.879517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.889926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548cec2-ef0c-4cb8-864c-c9793650a45e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.894501 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.895182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.895463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.895737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.896489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.898069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.908775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1217/2431] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:46.912501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.922894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da903-2702-4ec1-b8e1-87a174693b5c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.928209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.928936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.929223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.929523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.930350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.932152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249fb3b-4a51-429b-8cca-6e84949f075a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.942318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1215/2432] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:17:46.946405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:46.956407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3131d3-7fea-48a8-bc71-77343365a990 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:46.961004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:46.961878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:46.962159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:46.962465 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] PATH_INFO: `/v3/projects/2487b35459fd4e90a73537b2b5b5a7f7/users/8891803944204a79b98a480402da2d0f/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:46.977241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2487b35459fd4e90a73537b2b5b5a7f7, user_id=8891803944204a79b98a480402da2d0f, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:46.979845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:46.992540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1218/2433] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:17:46 2022] PUT /identity/v3/projects/2487b35459fd4e90a73537b2b5b5a7f7/users/8891803944204a79b98a480402da2d0f/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:17:47.003000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b5928-04b9-436c-a35c-1f199fba17c6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:47.003508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b5928-04b9-436c-a35c-1f199fba17c6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:47.004053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b5928-04b9-436c-a35c-1f199fba17c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:47.034648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-229b5928-04b9-436c-a35c-1f199fba17c6 None None] MFA Rules not processed for user `8891803944204a79b98a480402da2d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:47.035884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-229b5928-04b9-436c-a35c-1f199fba17c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:47.103502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1216/2434] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:17:47.114943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:17:47.116692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:17:47.172572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996bd99-993a-4256-85cf-503f9839e885 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:17:47.176245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:17:47.176876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:47.177161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:47.177438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:47.185576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:17:47.186993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:17:47.195618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1219/2435] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:17:57.100631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:57.191753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:17:59.967172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:17:59.967621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:17:59.967742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:17:59.985456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] MFA Rules not processed for user `da01cd253f6e4bc792868f337ff85b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:17:59.986656 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:00.041719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1217/2436] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:18:01.223584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:01.225055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:01.298305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae84d8f-19ea-49f9-b164-a5561872500c service glance] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:01.303273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:01.303986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:01.304267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:01.304544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:01.306330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:01.317491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:01.319042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea96d02-88be-4e2d-8d15-b8cfe06bff36 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:01.329456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1220/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:18:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:18:10.034724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:11.324581 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:15.224467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:15.285863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc60d0-f932-4ba9-b25a-7d2a457b84ef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:15.290383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:15.291240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:15.291522 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:15.291792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] PATH_INFO: `/v3/users/8891803944204a79b98a480402da2d0f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:15.293012 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8891803944204a79b98a480402da2d0f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:15.294921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:15.341626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8891803944204a79b98a480402da2d0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.348639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8891803944204a79b98a480402da2d0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.349292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8891803944204a79b98a480402da2d0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.356900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8891803944204a79b98a480402da2d0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.368783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8891803944204a79b98a480402da2d0f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.375147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1218/2438] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:18:15 2022] DELETE /identity/v3/users/8891803944204a79b98a480402da2d0f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:18:15.379710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:15.380248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:15.380355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:15.397735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:18:15.398928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:15.455125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1221/2439] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:18:15.464639 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:15.466034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:15.522481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a23a-237b-4b0a-9c28-31174764bfc7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:15.526113 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:15.526747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:15.527029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:15.527304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:15.536213 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:15.537662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:15.547048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1219/2440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:18:15.807691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:15.809156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:15.821890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1191-f7c3-444a-9365-d7849c8c4c02 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:15.827438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:15.828714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:15.828995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:15.829367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] PATH_INFO: `/v3/projects/2487b35459fd4e90a73537b2b5b5a7f7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:15.830479 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2487b35459fd4e90a73537b2b5b5a7f7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:15.833566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:15.882590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2487b35459fd4e90a73537b2b5b5a7f7', 'request_id': 'req-7012b731-8e56-4a8a-8262-098e6a6b15fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.890360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2487b35459fd4e90a73537b2b5b5a7f7', 'request_id': 'req-7012b731-8e56-4a8a-8262-098e6a6b15fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.897268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2487b35459fd4e90a73537b2b5b5a7f7', 'request_id': 'req-7012b731-8e56-4a8a-8262-098e6a6b15fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.907992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] The token cache is being invalidate because project 2487b35459fd4e90a73537b2b5b5a7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:18:15.908283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.908947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-7012b731-8e56-4a8a-8262-098e6a6b15fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:18:15.910738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1222/2441] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:18:15 2022] DELETE /identity/v3/projects/2487b35459fd4e90a73537b2b5b5a7f7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:18:19.888574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:19.897807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20edd9-eb37-4a90-9f41-cbf976a0f17c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:19.915412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:19.949387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:19.950031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:19.950365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:19.950585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:19.952433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:20.012831 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:20.014250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cf2f6-d1a6-4ddf-9bc7-37660393e799 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:20.024459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1220/2442] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:18:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:18:25.904847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:30.020046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=40 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:45.812546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:45.813097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:45.813209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:45.831704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] MFA Rules not processed for user `2020c486ef3e4fceb1d671269668ba68`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:18:45.832925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:45.886039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1223/2443] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:18:55.879130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:18:56.763283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a8b1-0eb9-4a7f-881a-e46f37b0923a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:56.763800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a8b1-0eb9-4a7f-881a-e46f37b0923a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:56.763948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a8b1-0eb9-4a7f-881a-e46f37b0923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:56.781864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-78e7a8b1-0eb9-4a7f-881a-e46f37b0923a None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:18:56.783181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-78e7a8b1-0eb9-4a7f-881a-e46f37b0923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:56.845566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1221/2444] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:18:56.895528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:18:56.897045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:18:56.973313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4751b-a4ba-472f-9a25-b6ddff9a964a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:18:56.978270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:18:56.978921 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:18:56.979206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:18:56.979481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:18:56.988616 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:18:56.990205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:18:56.998663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1224/2445] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:19:06.836660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=25 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:06.995181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=32 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:14.564923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94699ed-9e7f-4542-a145-0c14ca08e447 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:14.566091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94699ed-9e7f-4542-a145-0c14ca08e447 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:14.566091 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94699ed-9e7f-4542-a145-0c14ca08e447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:14.583690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b94699ed-9e7f-4542-a145-0c14ca08e447 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:19:14.584913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b94699ed-9e7f-4542-a145-0c14ca08e447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:14.592031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1222/2446] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:19:14.603636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:19:14.614525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9149-c149-41f6-baa3-38e1bee0379f service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:19:14.619374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:19:14.620029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:14.620308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:14.620577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:14.629080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:19:14.630633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:19:14.638862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1225/2447] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:19:24.578346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:24.635489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:38.595570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:38.596077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:38.596179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:38.616426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:19:38.618150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:38.625296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1223/2448] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:19:38.638202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:19:38.649400 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc1be-6732-48e5-acd8-e2d9ac848340 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:19:38.654734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:19:38.655375 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:38.655658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:38.655971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:38.665101 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:19:38.666674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:19:38.674791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1226/2449] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:19:48.608403 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:48.671424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:19:49.728876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:19:49.730507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:49.785186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6c3c2-84a8-4a7e-8ce2-9af0d32efdb0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:19:49.788682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:19:49.789440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:49.789740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:49.790013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:49.791736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:49.859443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:19:49.860899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:19:49.872093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1224/2450] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:19:55.088654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:19:55.090011 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:55.102404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3f917-1b69-4b3d-98ba-bb88df548cf4 service swift] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:19:55.106122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:19:55.106825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:19:55.107108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:19:55.107382 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:19:55.109156 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:19:55.122053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:19:55.123972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:19:55.134608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1227/2451] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:19:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:19:59.867306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=54 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:02.720217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:02.729572 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97121c2a-bcb4-4691-882d-d9a3ede4c8f8 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:02.733981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:02.734621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:02.734906 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:02.735181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:02.736997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:02.798250 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:02.799677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:02.809280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1225/2452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:05.129958 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:05.652395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:05.655339 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:05.679194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e0f0-4f2a-4fcd-9b68-6a8e2dd15948 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:05.685090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:05.686179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:05.686462 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:05.686740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] PATH_INFO: `/v3/users/5b45e8b15637406eb145ca6e756e1f44` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:05.700928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b45e8b15637406eb145ca6e756e1f44)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:05.702867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:05.756681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b45e8b15637406eb145ca6e756e1f44'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:05.763471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b45e8b15637406eb145ca6e756e1f44'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:05.764354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b45e8b15637406eb145ca6e756e1f44'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:05.764948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b45e8b15637406eb145ca6e756e1f44'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:05.771768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-77f7a4ed-25f0-447b-8cc9-735527d57346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b45e8b15637406eb145ca6e756e1f44'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:05.789005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1228/2453] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:20:05 2022] DELETE /identity/v3/users/5b45e8b15637406eb145ca6e756e1f44 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:05.958459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:05.969317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bf54f-d572-466d-b11a-dd6ca245d9f7 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.025952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.026813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.027099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.027376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] PATH_INFO: `/v3/projects/3fa6a9273bf24c67bfc20849da531320` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.038136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa6a9273bf24c67bfc20849da531320)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.040082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.085521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa6a9273bf24c67bfc20849da531320', 'request_id': 'req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:06.092869 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa6a9273bf24c67bfc20849da531320', 'request_id': 'req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:06.099497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa6a9273bf24c67bfc20849da531320', 'request_id': 'req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:06.109819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] The token cache is being invalidate because project 3fa6a9273bf24c67bfc20849da531320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:20:06.110105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:06.110734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a956ab7a-b8e8-43c0-ae72-3571a4db8ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:06.112305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1226/2454] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:20:05 2022] DELETE /identity/v3/projects/3fa6a9273bf24c67bfc20849da531320 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:06.117214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.117504 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.117786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.134930 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:06.136103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:06.194685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1229/2455] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:06.203066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.203382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.203655 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.221324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:06.222512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:06.230165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1227/2456] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:06.234241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.244026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd43b85-1689-446c-8dd2-b91dc0554d03 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.248716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.249348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.249632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.249910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.250640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:20:06.250950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.252585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.264759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1230/2457] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:20:06.268908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.278131 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df86b43-79aa-4b3e-b806-cdcaf9bb5766 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.283235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.283903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.284211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.284483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.285170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.287055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.290995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:06.314470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1228/2458] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:20:06 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:20:06.318795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.328609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55b56-339d-4ae9-ac3b-72df933b378c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.372131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:06.385557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.386161 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.386445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.386722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.387404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.389621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.409228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1231/2459] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:20:06 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:06.413090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.424058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccca272-b57e-4216-862c-84e158fe4229 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.428785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.429441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.429724 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.430003 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.430749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.432374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.442733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1229/2460] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:06.446477 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.456394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b744-f75b-43b6-a79e-4ee751bfc55a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.460988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.461627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.461910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.462203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.462908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.464537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58876e7e-f83e-497a-bb05-37297afd8846 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.474936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1232/2461] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:06.478670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.489062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1ba8-9462-4190-bb43-6b95a96cb0ff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.493728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.494595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.494879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.495153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] PATH_INFO: `/v3/projects/7ffd14b4769446d9931a7b2a987005fd/users/61c73b44a46943959b8b27d259622be2/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.509585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffd14b4769446d9931a7b2a987005fd, user_id=61c73b44a46943959b8b27d259622be2, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.512306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.524908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1230/2462] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:20:06 2022] PUT /identity/v3/projects/7ffd14b4769446d9931a7b2a987005fd/users/61c73b44a46943959b8b27d259622be2/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:06.535498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.535795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.536104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.562246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] MFA Rules not processed for user `61c73b44a46943959b8b27d259622be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:06.563473 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:06.625814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1233/2463] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:06.637147 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:06.639063 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:06.713641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5410c-8188-43a8-bcd6-5fb8e5312df7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:06.719669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:06.720349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:06.720631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:06.720911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:06.728411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:06.729974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e72a-79f8-4172-b7b2-38b44f5a7740 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:06.739210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1231/2464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:16.064841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.126590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5fb1d-5660-4860-bf1d-40992f11a968 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:16.131270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:16.132171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.132458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.132737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] PATH_INFO: `/v3/users/61c73b44a46943959b8b27d259622be2` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.133922 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c73b44a46943959b8b27d259622be2)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:16.135846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:16.181083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c73b44a46943959b8b27d259622be2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.188341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c73b44a46943959b8b27d259622be2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.188950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c73b44a46943959b8b27d259622be2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.189552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c73b44a46943959b8b27d259622be2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.193960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:16.197536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c73b44a46943959b8b27d259622be2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.215021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1234/2465] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:20:16 2022] DELETE /identity/v3/users/61c73b44a46943959b8b27d259622be2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:16.220066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.220554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.220657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.237978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:16.239166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:16.296449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1232/2466] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:20:16.306109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.307489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:16.362811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f7f6-9b58-4b3f-a1b8-16e9c5dc4f91 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:16.366404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:16.367028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.367307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.367579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.376482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:16.377881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075355b-f102-4f89-a26e-0875d1aa8c69 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:16.387032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1235/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:16.647561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.649050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:16.661882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8f282-3aea-4cd7-b783-4ed346a0669a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:16.666915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:16.667774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.668092 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.668363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] PATH_INFO: `/v3/projects/7ffd14b4769446d9931a7b2a987005fd` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.670376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffd14b4769446d9931a7b2a987005fd)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:16.672569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:16.709514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:16.723955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffd14b4769446d9931a7b2a987005fd', 'request_id': 'req-db34b1da-b38d-4e7a-a131-2bfcac2c2561'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.730773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffd14b4769446d9931a7b2a987005fd', 'request_id': 'req-db34b1da-b38d-4e7a-a131-2bfcac2c2561'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.737090 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffd14b4769446d9931a7b2a987005fd', 'request_id': 'req-db34b1da-b38d-4e7a-a131-2bfcac2c2561'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.747398 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] The token cache is being invalidate because project 7ffd14b4769446d9931a7b2a987005fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:20:16.747681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.748347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-db34b1da-b38d-4e7a-a131-2bfcac2c2561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:16.749878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1233/2468] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:20:16 2022] DELETE /identity/v3/projects/7ffd14b4769446d9931a7b2a987005fd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:16.754825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.755115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.755396 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.772969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:16.774152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:16.832388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1236/2469] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:20:16.841199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.841531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.842318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.861484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:16.862675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:16.870422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1234/2470] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:16.875104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.884576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0915a5-7ecb-4d81-bb5c-fb201e42b289 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:16.889825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:16.890463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.890739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.891006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.891722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:20:16.892058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:16.893627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:16.905323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1237/2471] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:20:16.908957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.918109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209dd8c-8fed-4395-8700-e20704229364 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:16.922789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:16.923429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:16.923713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:16.924021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:16.924717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:16.926601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:16.952516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1235/2472] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:20:16 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:16.956589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:16.966406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6661858-a8b0-448b-abab-e64f24a18fdb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:17.026041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:17.026631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.026917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.027196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.027902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:17.029810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:17.045237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:17.057773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1238/2473] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:20:16 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:17.062661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:17.072963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a363340-c705-409d-a706-8a0c46b90d76 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:17.078211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:17.078867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.079149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.079426 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.080187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:17.081795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:17.092960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1236/2474] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:17.097165 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:17.108526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4fb56-bd47-463b-928a-664c6f2d1b5b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:17.113131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:17.113781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.114064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.114341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.115061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:17.116672 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08852c77-156a-4f7f-858d-6a1f8af33ada admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:17.126986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1239/2475] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:17.131081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:17.142174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed61a4-6a8b-4ce9-949a-79f2a5dc9b53 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:17.146778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:17.147642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.147995 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.148280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] PATH_INFO: `/v3/projects/afda5c366590493fa517b5d624718190/users/14252bab9afe4dd5bc22e7f69fe9a54b/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.162736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afda5c366590493fa517b5d624718190, user_id=14252bab9afe4dd5bc22e7f69fe9a54b, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:17.165415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:17.178977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1237/2476] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:20:17 2022] PUT /identity/v3/projects/afda5c366590493fa517b5d624718190/users/14252bab9afe4dd5bc22e7f69fe9a54b/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:17.189757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.190046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.190355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.216527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] MFA Rules not processed for user `14252bab9afe4dd5bc22e7f69fe9a54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:17.217712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:17.280090 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1240/2477] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:17.291369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:17.293124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:17.365590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e10b50-fe2a-4ed4-9080-f96287f6211d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:17.371161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:17.371805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:17.372127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:17.372404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:17.380789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:17.382373 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b442cf-5781-4aee-b4b4-5c74712c2993 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:17.391405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1238/2478] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:20.046313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.106412 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ad2f8-a0ba-4fc2-a146-e4a8304c45e2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:20.111540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:20.112447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.112731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.113013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] PATH_INFO: `/v3/users/14252bab9afe4dd5bc22e7f69fe9a54b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.114193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=14252bab9afe4dd5bc22e7f69fe9a54b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:20.116135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:20.160746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14252bab9afe4dd5bc22e7f69fe9a54b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.168329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14252bab9afe4dd5bc22e7f69fe9a54b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.168932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14252bab9afe4dd5bc22e7f69fe9a54b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.170190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14252bab9afe4dd5bc22e7f69fe9a54b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.177079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14252bab9afe4dd5bc22e7f69fe9a54b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.186983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:20.196168 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1241/2479] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:20:20 2022] DELETE /identity/v3/users/14252bab9afe4dd5bc22e7f69fe9a54b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:20.200561 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.201054 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.201153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.218159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:20.219364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:20.256992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:20.279786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1239/2480] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:20.289239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.290654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:20.347968 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46bb1-814d-45a1-b028-7339a7996ccf admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:20.351806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:20.352497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.352776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.353050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.361969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:20.363379 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a7dcb-665a-4f10-af32-c6af99b9f75b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:20.372735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1242/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:20.645191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.646820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:20.661531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faf0ea-ff77-4d47-acf2-a0d6b1b2f2fd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:20.667385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:20.668902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.669430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.669931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] PATH_INFO: `/v3/projects/afda5c366590493fa517b5d624718190` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.671472 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afda5c366590493fa517b5d624718190)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:20.674741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:20.722061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afda5c366590493fa517b5d624718190', 'request_id': 'req-06aac75f-5214-4e7d-b296-d61335036ca1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.729658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afda5c366590493fa517b5d624718190', 'request_id': 'req-06aac75f-5214-4e7d-b296-d61335036ca1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.736138 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afda5c366590493fa517b5d624718190', 'request_id': 'req-06aac75f-5214-4e7d-b296-d61335036ca1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.746243 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] The token cache is being invalidate because project afda5c366590493fa517b5d624718190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:20:20.746528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.747156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-06aac75f-5214-4e7d-b296-d61335036ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:20:20.749222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1240/2482] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:20:20 2022] DELETE /identity/v3/projects/afda5c366590493fa517b5d624718190 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:20.754091 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.754383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.754663 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.772608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:20.773831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:20.831947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1243/2483] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:20.839523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.839839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.840125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.858211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:20.859415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:20.867314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1241/2484] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:20.871446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.881466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbb357-4e0c-458f-8297-411066795807 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:20.885992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:20.886634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.886912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.887182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.887936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:20:20.888242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:20.890627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:20.901734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1244/2485] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:20:20.905823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.915043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71522fe7-9eba-42cf-994f-aa9b4c6253ef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:20.919974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:20.920642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:20.920923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:20.921195 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:20.921872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:20.923755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:20.949538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1242/2486] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:20:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:20.954060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:20.964181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce359-123c-47bc-a579-5132fa9310ba admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.020781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.021437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.021719 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.021993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.022679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.024601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.043832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1245/2487] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:20:20 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:20:21.048453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.058455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de985a3-2660-4646-abd2-502956de0151 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.063660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.064348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.064627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.064899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.065613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.067199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.077325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1243/2488] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:20:21.081271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.091848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e8b0-cf5b-437d-94e4-87de7b4de002 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.096529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.097314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.097604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.097884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.098607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.100243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c8a50-9d6e-44be-845d-0934c81f54cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.110726 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1246/2489] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:21.114934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.125299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94436fb8-60e1-42de-9dc9-f48d6c53982e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.129867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.130728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.131008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.131279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] PATH_INFO: `/v3/projects/6d749fda2bf24a03ba093027c22ac72e/users/0f992ee44508464ebccc2fc645f1e803/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.145816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d749fda2bf24a03ba093027c22ac72e, user_id=0f992ee44508464ebccc2fc645f1e803, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.148505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.162062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1244/2490] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:20:21 2022] PUT /identity/v3/projects/6d749fda2bf24a03ba093027c22ac72e/users/0f992ee44508464ebccc2fc645f1e803/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:21.173951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.174244 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.174525 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.180230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:21.203751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] MFA Rules not processed for user `0f992ee44508464ebccc2fc645f1e803`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:21.205175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:21.267962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1247/2491] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:21.272357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.335576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5d97-9e48-4d11-8b90-1a6139a84a91 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.340369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.340996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.341283 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.341604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.342298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.344225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.348228 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:21.371861 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1245/2492] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:20:21 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:21.375975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.386426 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cc3c9-aba3-4396-abe7-1e3e2ed297c0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.441900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.442558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.442843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.443118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.443811 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.445738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.464802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1248/2493] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:20:21 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:20:21.469281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.479315 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638219a-df7e-48bb-8493-a8ed6486e970 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.484528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.485540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.485828 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.486109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.486835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.488761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.499233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1246/2494] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:20:21.503062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.513030 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de773ed9-7407-45b2-897e-0020eb5a1204 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.517935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.518798 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.519081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.519357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] PATH_INFO: `/v3/projects/ff5a3a535e354411abae2054582c5cb7/users/0cdb5b7a46ef49b78c3881e829c5206b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.535397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5a3a535e354411abae2054582c5cb7, user_id=0cdb5b7a46ef49b78c3881e829c5206b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.538052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.551598 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1249/2495] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:20:21 2022] PUT /identity/v3/projects/ff5a3a535e354411abae2054582c5cb7/users/0cdb5b7a46ef49b78c3881e829c5206b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:21.555642 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.565678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75dd0e-e15a-4258-be7d-670d4ab7d788 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.626452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.627032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.627317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.627594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.628361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.629954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505c797-c787-4723-8122-52e0d4a7fecb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.639965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1247/2496] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:20:21.644351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.655050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca7e-73bf-4234-8828-3a7c6b94f2ea admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.659661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.660561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.660841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.661127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] PATH_INFO: `/v3/projects/ff5a3a535e354411abae2054582c5cb7/users/0cdb5b7a46ef49b78c3881e829c5206b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.663072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5a3a535e354411abae2054582c5cb7, user_id=0cdb5b7a46ef49b78c3881e829c5206b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.665704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.676394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1250/2497] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:20:21 2022] PUT /identity/v3/projects/ff5a3a535e354411abae2054582c5cb7/users/0cdb5b7a46ef49b78c3881e829c5206b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:20:21.686435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.686761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.687047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.714500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] MFA Rules not processed for user `0cdb5b7a46ef49b78c3881e829c5206b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:21.715722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:21.783618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1248/2498] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:20:21.794740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.796572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:21.844320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:21.855295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731966d-114e-49ca-b78e-c653a72a9d14 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.858949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.859587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.859901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.860179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:21.869110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:21.870527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:21.879907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1251/2499] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:21.953260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:21.962796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79d89a-c7e7-4163-a534-f498f48c9643 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:21.966427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:21.967602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:21.967921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:21.968201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:22.024961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:22.027355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:22.029934 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:22.039381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1249/2500] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:31.875890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:32.035458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:20:47.516897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:47.525533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd1ad-131c-45dd-8378-bc74b1d5783c service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:47.529130 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:47.529750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:47.530029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:47.530302 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:47.532730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:47.610670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:47.612142 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:47.630499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1252/2501] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:55.202324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:55.203978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:55.421369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408ae3d-428f-4ebe-b572-214602fd74d4 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:55.431253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:55.431899 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:55.432326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:55.432602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:55.436150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:55.465532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:55.469681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b339fd-6f30-48e2-81ac-9642c6d12bd9 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:55.497214 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1250/2502] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:55.720649 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:20:55.724178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:55.813425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa67d-46d6-416f-8dc4-7a60b40c42d3 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:20:55.819736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:20:55.820428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:55.820755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:55.821034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:55.824586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:55.967383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:20:55.970096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:20:55.982184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1253/2503] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:20:57.908030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:20:57.908592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:20:57.908592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:20:57.925821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] MFA Rules not processed for user `da01cd253f6e4bc792868f337ff85b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:20:57.927289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:20:57.984817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1251/2504] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:20:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:00.059252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.060750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:00.079001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f73b-2606-4e4f-a661-53f26e7c61f1 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.083936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.085073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.085575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.085924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] PATH_INFO: `/v3/users/2020c486ef3e4fceb1d671269668ba68` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.106261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2020c486ef3e4fceb1d671269668ba68)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.108272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.110664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:00.156721 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2020c486ef3e4fceb1d671269668ba68'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.164899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2020c486ef3e4fceb1d671269668ba68'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.165607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2020c486ef3e4fceb1d671269668ba68'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.166209 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2020c486ef3e4fceb1d671269668ba68'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.173056 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-dc6ca5f1-41a4-4b6b-ad79-6f06b9d77e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2020c486ef3e4fceb1d671269668ba68'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.190449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1254/2505] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:00 2022] DELETE /identity/v3/users/2020c486ef3e4fceb1d671269668ba68 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:00.366297 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.378335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec4ac9-d97f-4568-b606-84dd43b17e48 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.435836 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.436922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.437305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.438388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] PATH_INFO: `/v3/projects/f81b8fe398ae4ed19d6b9f49f6490e5a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.449109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81b8fe398ae4ed19d6b9f49f6490e5a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.451006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.474939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:00.497146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'request_id': 'req-66193385-a5a3-4c0e-9884-fe103eb86c1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.504681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'request_id': 'req-66193385-a5a3-4c0e-9884-fe103eb86c1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.511106 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81b8fe398ae4ed19d6b9f49f6490e5a', 'request_id': 'req-66193385-a5a3-4c0e-9884-fe103eb86c1a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.521921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] The token cache is being invalidate because project f81b8fe398ae4ed19d6b9f49f6490e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:00.522206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.522862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-66193385-a5a3-4c0e-9884-fe103eb86c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:00.524451 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1252/2506] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:00 2022] DELETE /identity/v3/projects/f81b8fe398ae4ed19d6b9f49f6490e5a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:00.529451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.529742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.530024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.548499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:00.549601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:00.609437 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1255/2507] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:00.618496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.618772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.619071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.638381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:00.640196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:00.648470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1253/2508] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:00.652579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.662401 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b320845-7af4-4e94-96c2-7c4b1f757303 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.666975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.667620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.667943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.668223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.668950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:00.669259 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.670856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.682787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1256/2509] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:00.686923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.696866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532087-a46a-456a-9558-5555985d1a57 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.701560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.702196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.702479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.702755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.703435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.705405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.731317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1254/2510] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:00 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:00.735977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.745964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f04d-80be-4413-980d-69b59cb0474b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.801288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.801880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.802164 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.802442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.803132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.805063 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.820061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:00.826257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1257/2511] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:00 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:00.830465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.840956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd146d-a5d5-4ba3-a276-5b52aa283e0a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.846069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.846714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.846994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.847266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.848017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.849606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.859325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1255/2512] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:00.863677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.873591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21ad8-de99-414f-a17e-3e30e6585063 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.878103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.878749 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.879027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.879299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.880309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.881876 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f81a74-c54b-427a-84c4-af679341e1ae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.891903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1258/2513] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:00.895895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:00.905917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec022c-dee5-4477-a5f9-81e6caa3fcb5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:00.911132 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:00.912070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.912355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.912634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] PATH_INFO: `/v3/projects/3ee583d6732d49d1935e18061efd5fc2/users/f2df17d94f374f46aabdfb99972de272/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.927757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee583d6732d49d1935e18061efd5fc2, user_id=f2df17d94f374f46aabdfb99972de272, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:00.930562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:00.946144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1256/2514] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:00 2022] PUT /identity/v3/projects/3ee583d6732d49d1935e18061efd5fc2/users/f2df17d94f374f46aabdfb99972de272/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:00.956216 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:00.956514 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:00.956797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:00.984131 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] MFA Rules not processed for user `f2df17d94f374f46aabdfb99972de272`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:00.985988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:01.048568 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1259/2515] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:01.053298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.114911 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9567-1b9c-4d54-8ec3-b034f3dd0528 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.119449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.120133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.120415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.120690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.121363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.123247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.148128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1257/2516] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:01 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:01.152127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.163425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae76c7-1ffe-4e36-9809-1525a19e93e1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.232657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.233340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.233625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.233935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.235251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.237309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.261044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1260/2517] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:01 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:01.265386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.277504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac1b2-2430-441c-9dad-de74fe947481 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.282938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.283662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.284053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.284391 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.285178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.286843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.298571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1258/2518] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:01.302561 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.313934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ccd37-32aa-4f94-a5cd-09f9ffa082b8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.318680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.319589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.319904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.320187 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] PATH_INFO: `/v3/projects/e03f1e9279774428857c9064d60cddd8/users/32ce204c3444447299dbe20cc4be58f4/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.335083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1e9279774428857c9064d60cddd8, user_id=32ce204c3444447299dbe20cc4be58f4, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.337746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.350724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1261/2519] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:01 2022] PUT /identity/v3/projects/e03f1e9279774428857c9064d60cddd8/users/32ce204c3444447299dbe20cc4be58f4/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:01.354802 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.365295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8cde-fb50-4fb7-93b7-e9b49eaadc24 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.382959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:01.423415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.424102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.424383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.424653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.425361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.426948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8120f8-84e0-452f-b707-f5a31cd2076a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.437009 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1259/2520] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:01.441304 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.451328 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565818-fbf0-4561-ab3e-68716a02f491 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.456407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.457275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.457555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.457825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] PATH_INFO: `/v3/projects/e03f1e9279774428857c9064d60cddd8/users/32ce204c3444447299dbe20cc4be58f4/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.459783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1e9279774428857c9064d60cddd8, user_id=32ce204c3444447299dbe20cc4be58f4, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.462403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.472727 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1262/2521] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:01 2022] PUT /identity/v3/projects/e03f1e9279774428857c9064d60cddd8/users/32ce204c3444447299dbe20cc4be58f4/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:01.482584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.482879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.483181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.509298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] MFA Rules not processed for user `32ce204c3444447299dbe20cc4be58f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:01.510512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:01.578786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1260/2522] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:01.590066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.591766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:01.623704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:01.649751 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05100-5fcd-46e0-876b-54f8de530cf4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.653378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.654009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.654289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.654565 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.663945 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.665343 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.674498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1263/2523] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:01.745976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:01.755637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c927-d88e-4383-9322-6328ea5ab901 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:01.759230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:01.759892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:01.760179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:01.760455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:01.816489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:01.817917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:01.826755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1261/2524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:04.131881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:04.133213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:04.231642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1de496-7a48-4f8d-8e0f-55ce29798911 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:04.236870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:04.238652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:04.240182 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:04.240536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:04.241003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:04.243138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:04.246975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59b5-1676-4bb2-9080-2b3ef236b6c9 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:04.251260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:04.252006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:04.252292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:04.252576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:04.254733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:04.255012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:04.256842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:04.267593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1264/2525] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:04.308855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:04.346060 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:04.348121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:04.361716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1262/2526] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:08.243121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:08.244685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:08.258997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6c8cc-3871-4722-93b0-0d0b4fa6e34c service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:08.263954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:08.265383 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.266104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.266520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] PATH_INFO: `/v3/users/d75d976f2c554209bc4c64d338ad7cf7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.267776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75d976f2c554209bc4c64d338ad7cf7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:08.269738 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:08.319934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75d976f2c554209bc4c64d338ad7cf7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.328843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75d976f2c554209bc4c64d338ad7cf7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.329553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75d976f2c554209bc4c64d338ad7cf7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.330272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75d976f2c554209bc4c64d338ad7cf7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.337891 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d26f856c-7d03-4854-940e-ecb7eb5570d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75d976f2c554209bc4c64d338ad7cf7'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.356576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1265/2527] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:08 2022] DELETE /identity/v3/users/d75d976f2c554209bc4c64d338ad7cf7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:08.533901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:08.544310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafc31b-23a6-46d8-a5f1-d4acb8c55c58 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:08.617590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:08.618598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.618953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.619333 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] PATH_INFO: `/v3/projects/3910745b858045628982687e473c23b7` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.620630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3910745b858045628982687e473c23b7)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:08.622605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:08.670788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3910745b858045628982687e473c23b7', 'request_id': 'req-b6e99795-53e4-423c-9ab6-8e5c5478f8df'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.679284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3910745b858045628982687e473c23b7', 'request_id': 'req-b6e99795-53e4-423c-9ab6-8e5c5478f8df'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.686163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3910745b858045628982687e473c23b7', 'request_id': 'req-b6e99795-53e4-423c-9ab6-8e5c5478f8df'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.697833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] The token cache is being invalidate because project 3910745b858045628982687e473c23b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:08.698122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.698791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6e99795-53e4-423c-9ab6-8e5c5478f8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:08.700719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1263/2528] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:08 2022] DELETE /identity/v3/projects/3910745b858045628982687e473c23b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:08.705591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.705881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.706159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.724357 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:08.725637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:08.776867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:08.797851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1266/2529] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:08.806087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.806678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.807033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.830819 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:08.832729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:08.845027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1264/2530] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:08.852280 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:08.868624 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7169f9a-9bb8-47db-877e-1ae5287881d9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:08.874744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:08.876284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.876701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.877173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.878066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:08.878369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:08.880332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:08.901260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1267/2531] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:08.906165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:08.917133 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9dc6-2b10-41fa-9a4c-f2266fbd6fcc None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:08.925112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:08.925878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:08.926336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:08.926847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:08.927566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:08.929646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:08.974150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1265/2532] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:08 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:08.977394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:08.990149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d8a41-17a6-4ac1-ac2a-74c54c6699a3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.064233 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.066323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.066748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.067125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.068114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.070229 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.121068 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1268/2533] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:08 2022] POST /identity/v3/users => generated 279 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:09.123508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.140355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63e514-6b15-44c5-94a3-835e0676a7d4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.146895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.148089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.148555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.149666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.150841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.153223 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.175287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1266/2534] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:09.178710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.192960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b137d12-0a53-42d8-aaa0-21523479dee3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.220136 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.220830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.221120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.221402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.222149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.223772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4c12-74c0-477d-9a52-c25b7b044825 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.249662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1269/2535] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:09.253820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.265852 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2919ea-c3b3-4322-9347-f3def059fb23 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.278720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.280876 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.283905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.284279 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] PATH_INFO: `/v3/projects/ff1a312d7b1e4059927c1caeeb7f63b2/users/f62089f4d379446382480528acac4ef8/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.330024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1a312d7b1e4059927c1caeeb7f63b2, user_id=f62089f4d379446382480528acac4ef8, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.333158 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.354662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1267/2536] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:09 2022] PUT /identity/v3/projects/ff1a312d7b1e4059927c1caeeb7f63b2/users/f62089f4d379446382480528acac4ef8/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:09.365969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.366262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.366533 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.402810 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] MFA Rules not processed for user `f62089f4d379446382480528acac4ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:09.404071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:09.492035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1270/2537] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:09.495189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.500040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:09.568255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46137df-0a95-4aca-9646-675f1188eae4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.575077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.575997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.576424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.576968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.577646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.580667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.581213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.582765 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:09.598330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c98b8b-193b-4ab7-977c-23b163527712 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.603212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.604115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.604395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.604666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] PATH_INFO: `/v3/users/0f992ee44508464ebccc2fc645f1e803` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.605956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f992ee44508464ebccc2fc645f1e803)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.608007 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.612486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1268/2538] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:09 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:09.613532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.647845 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:09.659574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f992ee44508464ebccc2fc645f1e803'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:09.668024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f992ee44508464ebccc2fc645f1e803'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:09.668800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f992ee44508464ebccc2fc645f1e803'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:09.669457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f992ee44508464ebccc2fc645f1e803'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:09.678285 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-51a40f17-3b18-4aad-9e0f-1fa0ac59a54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f992ee44508464ebccc2fc645f1e803'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:09.686247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006f4d5-3f7a-4f72-a3bb-6918098fb6ba admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.692001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.692677 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.692961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.693257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.693931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.695987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.698049 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1271/2539] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:09 2022] DELETE /identity/v3/users/0f992ee44508464ebccc2fc645f1e803 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:09.702391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.702685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.703492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.721456 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1269/2540] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:09 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:09.723695 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:09.724949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:09.725151 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.726720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:09.738440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0a3e-4ce3-40fe-bf6e-bde385635b0d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.783457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1272/2541] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:09.793133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.794630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:09.796484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.797188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.797474 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.797752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.798484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.800239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.813853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1270/2542] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:09.814840 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.825901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa71e-cc7c-410c-8807-bb0c7b04d797 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.832817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.834010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.834440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.834815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] PATH_INFO: `/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf/users/dd9d1f96ae2f42568d2cc74231456ba5/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.847026 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:09.851072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fd9624c6b34a9d9f4bab04c08100bf, user_id=dd9d1f96ae2f42568d2cc74231456ba5, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.855153 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.860196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0e89-fed7-4345-9208-9770032d4ba5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.864145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.864786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.865066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.865336 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.869625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1271/2543] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:09 2022] PUT /identity/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf/users/dd9d1f96ae2f42568d2cc74231456ba5/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:09.873383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.878284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.879761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.890320 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1273/2544] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:09.939035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51c966-57b4-4741-80e1-e9366bbc6810 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.945304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.946348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.946635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.946955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.947758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.949636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958dcdc-b037-4af6-bfc1-838db5596ea7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.961240 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1272/2545] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:09.965488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:09.975938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e41ad-6ef7-412b-b25c-e19b7a498800 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:09.980662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:09.981543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:09.981825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:09.982102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] PATH_INFO: `/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf/users/dd9d1f96ae2f42568d2cc74231456ba5/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:09.984098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fd9624c6b34a9d9f4bab04c08100bf, user_id=dd9d1f96ae2f42568d2cc74231456ba5, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:09.986733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:09.997927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1274/2546] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:09 2022] PUT /identity/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf/users/dd9d1f96ae2f42568d2cc74231456ba5/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:10.008760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.009058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.009341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.037424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] MFA Rules not processed for user `dd9d1f96ae2f42568d2cc74231456ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:10.038674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:10.114624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1273/2547] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:10.128838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:10.131341 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:10.184919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:10.187999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:10.196173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:10.213036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57bf4-1a3b-4570-9df5-49b38d52c9c0 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:10.217939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:10.218626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.218906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.219180 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.237210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:10.239104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:10.250513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1275/2548] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:10.278542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62118-e82c-4aae-90d4-1d3e68361ec7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:10.288005 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:10.289074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.289187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.289432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] PATH_INFO: `/v3/projects/6d749fda2bf24a03ba093027c22ac72e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.290793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d749fda2bf24a03ba093027c22ac72e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:10.293152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:10.306573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:10.342399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:10.342630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d749fda2bf24a03ba093027c22ac72e', 'request_id': 'req-2c4ce930-10d0-4496-bd99-d13e71355583'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.350855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d749fda2bf24a03ba093027c22ac72e', 'request_id': 'req-2c4ce930-10d0-4496-bd99-d13e71355583'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.351669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd55f9-9524-440f-b202-b05ed7c4e478 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:10.357306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d749fda2bf24a03ba093027c22ac72e', 'request_id': 'req-2c4ce930-10d0-4496-bd99-d13e71355583'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.368192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] The token cache is being invalidate because project 6d749fda2bf24a03ba093027c22ac72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:10.368477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.369691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.371268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1274/2549] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:10 2022] DELETE /identity/v3/projects/6d749fda2bf24a03ba093027c22ac72e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:10.375569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:10.376904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:10.408571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:10.409279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.409566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.409841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.412346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:10.445915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ce930-10d0-4496-bd99-d13e71355583 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:10.450581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:10.451463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.451737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.452035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] PATH_INFO: `/v3/users/0cdb5b7a46ef49b78c3881e829c5206b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.453247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdb5b7a46ef49b78c3881e829c5206b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:10.455160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:10.480126 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:10.481675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:10.493509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1276/2550] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:10 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:10.502510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdb5b7a46ef49b78c3881e829c5206b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.511045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdb5b7a46ef49b78c3881e829c5206b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.511230 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdb5b7a46ef49b78c3881e829c5206b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.518735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdb5b7a46ef49b78c3881e829c5206b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.531536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-9075cc7d-d170-41f9-ae80-4959bdf36b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdb5b7a46ef49b78c3881e829c5206b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.539141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1275/2551] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:10 2022] DELETE /identity/v3/users/0cdb5b7a46ef49b78c3881e829c5206b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:10.853362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:10.867494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574fae5-7737-48f2-843b-9c425b8fe37e service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:10.930225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:10.931160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:10.931438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:10.931712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] PATH_INFO: `/v3/projects/ff5a3a535e354411abae2054582c5cb7` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:10.933023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5a3a535e354411abae2054582c5cb7)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:10.935016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:10.978925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:10.983435 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5a3a535e354411abae2054582c5cb7', 'request_id': 'req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.991268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5a3a535e354411abae2054582c5cb7', 'request_id': 'req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:10.997725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5a3a535e354411abae2054582c5cb7', 'request_id': 'req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:11.007987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] The token cache is being invalidate because project ff5a3a535e354411abae2054582c5cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:11.008271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:11.008915 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-3287c304-10ea-4c1c-88d6-30f6b4eff3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:11.010468 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1277/2552] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:10 2022] DELETE /identity/v3/projects/ff5a3a535e354411abae2054582c5cb7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:11.017020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.017521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.017621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.036129 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:11.037342 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:11.051255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:11.103839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1276/2553] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:11.112410 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.112902 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.113220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.132152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:11.133451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:11.142516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1278/2554] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:11.146734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.157246 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294653-9679-4a0c-8461-c9dfd07db8a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.162332 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.162988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.163378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.163772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.164553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:11.164863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.166497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.178098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1277/2555] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:11.182301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.191488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5aae-971c-483d-8983-f3632a14dd8d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.196181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.196817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.197102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.197384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.198084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.200016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.226904 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1279/2556] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:11.230949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.240894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcbb26-edd8-4ea9-9d56-11b1d2a9866d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.296881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.297625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.297910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.298183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.298859 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.300784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.322610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1278/2557] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:11.327186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.339059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6707-67a9-44cf-86f5-142da58349da admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.343813 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.344492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.344772 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.345046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.345863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.347451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.358446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1280/2558] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:11.362833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.373078 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6f17-4575-48fb-9858-36f2b5a85af4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.379579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.380306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.380592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.380868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.381599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.383199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc95bf-fdda-4a6f-9e3a-723e26e697ea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.394470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1279/2559] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:11.398688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.408916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2138-54a4-4802-b91a-cca99c447c71 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.413572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.414451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.414736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.415012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] PATH_INFO: `/v3/projects/0c4b9ab45d8943dca595b0c4058af423/users/0cade86fc9394e938f883b148a8a339f/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.429737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4b9ab45d8943dca595b0c4058af423, user_id=0cade86fc9394e938f883b148a8a339f, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.432407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.446734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1281/2560] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:11 2022] PUT /identity/v3/projects/0c4b9ab45d8943dca595b0c4058af423/users/0cade86fc9394e938f883b148a8a339f/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:11.457813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119c06-34f8-46dd-aecd-864248080cba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.458206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119c06-34f8-46dd-aecd-864248080cba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.458492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119c06-34f8-46dd-aecd-864248080cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.494423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-40119c06-34f8-46dd-aecd-864248080cba None None] MFA Rules not processed for user `0cade86fc9394e938f883b148a8a339f`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:11.495660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-40119c06-34f8-46dd-aecd-864248080cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:11.558972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1280/2561] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:11.564040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.623569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbbcc5-29c3-4bf0-849c-1de00ef8d793 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.628928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.629579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.629861 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.630139 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.630828 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.632755 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.658805 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1282/2562] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:11.662480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119c06-34f8-46dd-aecd-864248080cba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.673580 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119c06-34f8-46dd-aecd-864248080cba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.685172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:11.735088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.735806 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.736186 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.736470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.737171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.739185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.761811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1281/2563] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:11 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:11.766166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.777668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b762-0eb1-4f70-ac65-8a55cbddbb75 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.782421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.783354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.783638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.784018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.784878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.786602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.798822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1283/2564] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:11.802922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.814743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063520d-6e09-475c-8c10-29582c58c832 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.819477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.820427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.820712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.820991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] PATH_INFO: `/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe/users/9c41f55f6f1548899d0a8d98b9487d15/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.835942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cfa9d5c8bc4907af647ca3cb472bbe, user_id=9c41f55f6f1548899d0a8d98b9487d15, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.839058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.855071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1282/2565] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:11 2022] PUT /identity/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe/users/9c41f55f6f1548899d0a8d98b9487d15/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:11.861515 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.872318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c450f-3a4f-43f7-8425-6a0112ae7b44 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.924789 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:11.944839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.945555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.945844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.946171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.947023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.949062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfadc8-5c6f-4b5c-9221-541ce5f0158b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:11.960896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1284/2566] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:11.965253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:11.976173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050f5d-efef-43d6-9125-2224659bc435 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:11.981235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:11.982116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:11.982392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:11.982661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] PATH_INFO: `/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe/users/9c41f55f6f1548899d0a8d98b9487d15/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:11.985416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cfa9d5c8bc4907af647ca3cb472bbe, user_id=9c41f55f6f1548899d0a8d98b9487d15, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:11.988353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.002494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1283/2567] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:11 2022] PUT /identity/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe/users/9c41f55f6f1548899d0a8d98b9487d15/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:12.014881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.015179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.015566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.019268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.021020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.044000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] MFA Rules not processed for user `9c41f55f6f1548899d0a8d98b9487d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:12.045198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.085577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fbff4-088f-4123-a98e-6ace99304759 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.090322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.091189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.091466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.091736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] PATH_INFO: `/v3/users/f2df17d94f374f46aabdfb99972de272` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.092964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2df17d94f374f46aabdfb99972de272)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.095674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.121348 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1285/2568] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:12.133050 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.134415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.145492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2df17d94f374f46aabdfb99972de272'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.153085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2df17d94f374f46aabdfb99972de272'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.154513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2df17d94f374f46aabdfb99972de272'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.162390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2df17d94f374f46aabdfb99972de272'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.168205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:12.177150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-2e14924d-01c0-48d0-855a-618d7d9b383d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2df17d94f374f46aabdfb99972de272'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.183483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1284/2569] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:12 2022] DELETE /identity/v3/users/f2df17d94f374f46aabdfb99972de272 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:12.187754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.188072 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.188348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.197248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f768-e1d0-4a92-a6cb-09d46cf51a11 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.209411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:12.210633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.247284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.247872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.248154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.248547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.250445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.269203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1285/2570] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:12.278797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.280325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.285497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:12.316119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.317552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.327167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1286/2571] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:12.337233 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18a3c7-8d35-44ed-995d-f40e3091e32c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.341436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.342079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.342363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.342634 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.352353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.353781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.364366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1286/2572] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:12.494297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.495776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.507770 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422aa3d-5c3c-43a2-b130-4e1d85c6cc49 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.511690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.512493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.512858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.513208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.516103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.588503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.589965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.599647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1287/2573] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:12.718034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.720432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:12.738636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7845-5ff5-4593-885b-246b178bfb70 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.744309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.745505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.746386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.746769 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] PATH_INFO: `/v3/projects/3ee583d6732d49d1935e18061efd5fc2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.748506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee583d6732d49d1935e18061efd5fc2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.751370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:12.804058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee583d6732d49d1935e18061efd5fc2', 'request_id': 'req-4679bc07-7c90-40c6-bca0-83d084e98829'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.815239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee583d6732d49d1935e18061efd5fc2', 'request_id': 'req-4679bc07-7c90-40c6-bca0-83d084e98829'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.822817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee583d6732d49d1935e18061efd5fc2', 'request_id': 'req-4679bc07-7c90-40c6-bca0-83d084e98829'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.836754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] The token cache is being invalidate because project 3ee583d6732d49d1935e18061efd5fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:12.837047 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.837991 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:12.840088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1287/2574] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:12 2022] DELETE /identity/v3/projects/3ee583d6732d49d1935e18061efd5fc2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:12.844177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:12.862043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7539-659a-4ce9-899b-7495bfd759e8 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:12.957337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:12.958314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:12.958596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:12.958870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] PATH_INFO: `/v3/users/32ce204c3444447299dbe20cc4be58f4` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:12.960138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ce204c3444447299dbe20cc4be58f4)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:12.962110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.010826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ce204c3444447299dbe20cc4be58f4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.019852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ce204c3444447299dbe20cc4be58f4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.020469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ce204c3444447299dbe20cc4be58f4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.021532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ce204c3444447299dbe20cc4be58f4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.028629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0eaa790e-cc93-404f-9ec5-a2e4646cfea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ce204c3444447299dbe20cc4be58f4'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.038313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:13.054574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1288/2575] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:12 2022] DELETE /identity/v3/users/32ce204c3444447299dbe20cc4be58f4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:13.344179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.345716 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:13.360706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679bc07-7c90-40c6-bca0-83d084e98829 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.370587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:13.420298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.421157 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.421443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.421748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] PATH_INFO: `/v3/projects/e03f1e9279774428857c9064d60cddd8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.422930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03f1e9279774428857c9064d60cddd8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.425098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.470516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03f1e9279774428857c9064d60cddd8', 'request_id': 'req-156bf54a-b0f7-4dc3-a318-6087ef310188'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.476872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03f1e9279774428857c9064d60cddd8', 'request_id': 'req-156bf54a-b0f7-4dc3-a318-6087ef310188'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.483150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03f1e9279774428857c9064d60cddd8', 'request_id': 'req-156bf54a-b0f7-4dc3-a318-6087ef310188'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.493282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] The token cache is being invalidate because project e03f1e9279774428857c9064d60cddd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:13.493563 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.494188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-156bf54a-b0f7-4dc3-a318-6087ef310188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:13.495691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1288/2576] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:13 2022] DELETE /identity/v3/projects/e03f1e9279774428857c9064d60cddd8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:13.500559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.501035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.501175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.519776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:13.520966 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:13.582553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1289/2577] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:13.591809 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.592212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.592498 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.611100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:13.612376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:13.620312 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1289/2578] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:13.625381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.635117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1f245-4d65-4321-a2b2-ce74d1834413 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.639892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.641166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.641444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.641716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.642434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:13.642762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.644369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.656104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1290/2579] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:13.660419 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.669539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca6c8c-ec0f-469f-b20f-d01cb21397bb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.674165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.674808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.675088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.675359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.676070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.677948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.703449 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1290/2580] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:13 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:13.707389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.717288 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0124d09-9ca1-48e1-af02-353df4db7fe9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.773823 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.774405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.774690 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.774965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.775665 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.777604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.800349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1291/2581] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:13 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:13.801591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.811839 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3b49a-0c69-46cd-b078-4dfde81d1d43 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.817517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772897f1-f19d-4977-9986-24700670550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.818270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772897f1-f19d-4977-9986-24700670550f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.818620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772897f1-f19d-4977-9986-24700670550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.818964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772897f1-f19d-4977-9986-24700670550f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.819763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772897f1-f19d-4977-9986-24700670550f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.821423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772897f1-f19d-4977-9986-24700670550f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.835891 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1291/2582] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:13.837439 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.847487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0497e7-4064-45cd-83cc-fdd6d62ef9cb admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.852467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.853135 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.853429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.853711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.854441 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.856076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f79cb5-68a3-4281-80fa-ae9ae328c088 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.868160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1292/2583] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:13.873841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772897f1-f19d-4977-9986-24700670550f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:13.888258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772897f1-f19d-4977-9986-24700670550f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:13.894128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:13.895002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.895281 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.895550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] PATH_INFO: `/v3/projects/c0cbc203c35540f99ffa4d770f1279f9/users/ea70b08db24449b6b0959988b4722d45/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.911096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cbc203c35540f99ffa4d770f1279f9, user_id=ea70b08db24449b6b0959988b4722d45, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:13.913736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:13.930077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1292/2584] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:13 2022] PUT /identity/v3/projects/c0cbc203c35540f99ffa4d770f1279f9/users/ea70b08db24449b6b0959988b4722d45/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:13.940748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:13.941035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:13.941340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:13.969630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] MFA Rules not processed for user `ea70b08db24449b6b0959988b4722d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:13.970875 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:14.020539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:14.046284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1293/2585] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:14.051723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.105121 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:14.134452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6f57d-301d-45a5-8232-7382d5bfd642 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.139161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.140127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.140445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.140726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.141412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.143323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.175144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1293/2586] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:14 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:14.179542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.191069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7de0-80f7-4047-92b9-b866bb24c87d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.252592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.253272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.253656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.253972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.254730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.256724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.279645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1294/2587] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:14 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:14.281510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.291543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d3e9-2c5b-47ab-be5e-281fa1ed273b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.296480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.297444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.297725 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.298019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.298744 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.300533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.311362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1294/2588] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:14.317045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.326947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0063-7d23-4809-a4fd-325e1aa82217 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.332192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.333176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.333526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.333897 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] PATH_INFO: `/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b/users/2ac5a363a22445bc995db146c897e87b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.350498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c0f98dc81d4e28b5b87e427fdb0c8b, user_id=2ac5a363a22445bc995db146c897e87b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.353228 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.367519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1295/2589] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:14 2022] PUT /identity/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b/users/2ac5a363a22445bc995db146c897e87b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:14.371534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.381807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af916-2cb9-4898-b0d6-ebc62cc63901 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.441232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.441900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.442180 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.442452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.443171 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.444792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f0da4-a544-4343-99b8-406733a72204 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.455265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1295/2590] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:14.459487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.470571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd2a2-65e1-4e2f-80e1-0aac5961a496 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.475590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.476562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.476909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.477248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] PATH_INFO: `/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b/users/2ac5a363a22445bc995db146c897e87b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.479314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c0f98dc81d4e28b5b87e427fdb0c8b, user_id=2ac5a363a22445bc995db146c897e87b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.482023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.492940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1296/2591] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:14 2022] PUT /identity/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b/users/2ac5a363a22445bc995db146c897e87b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:14.504305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.504597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.504903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.531898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] MFA Rules not processed for user `2ac5a363a22445bc995db146c897e87b`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:14.533115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:14.611847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1296/2592] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:14.622781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.624557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:14.682761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869d02-8909-4e75-89c6-1afc10a16c2e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.686395 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.687044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.687326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.687604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.696846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.698267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b6f10-113b-4c9e-9882-f2ecd29a3603 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.708559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1297/2593] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:14.837577 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:14.875638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:14.900034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cced0-0bdf-49d0-8fe1-d4c169476947 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:14.904519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:14.905409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.905690 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.906636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] PATH_INFO: `/v3/users/ea70b08db24449b6b0959988b4722d45` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:14.907704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea70b08db24449b6b0959988b4722d45)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:14.909663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:14.957360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea70b08db24449b6b0959988b4722d45'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:14.964270 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea70b08db24449b6b0959988b4722d45'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:14.964884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea70b08db24449b6b0959988b4722d45'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:14.972735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea70b08db24449b6b0959988b4722d45'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:14.985019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea70b08db24449b6b0959988b4722d45'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:14.991843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1297/2594] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:14 2022] DELETE /identity/v3/users/ea70b08db24449b6b0959988b4722d45 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:14.996370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:14.996666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:14.996947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:15.014646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:15.016467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:15.051716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:15.080840 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1298/2595] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:15.090564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:15.092001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:15.148520 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355765d-be65-4ba8-b3e7-805df0ed1828 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:15.152359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:15.153006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:15.153311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:15.153583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:15.163085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:15.164574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:15.174630 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1298/2596] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:15.445988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:15.447535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:15.463878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0d8f-e75c-49cd-9803-0aafc88f48bf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:15.469238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:15.470133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:15.470440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:15.470817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] PATH_INFO: `/v3/projects/c0cbc203c35540f99ffa4d770f1279f9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:15.471977 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cbc203c35540f99ffa4d770f1279f9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:15.473782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:15.519814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cbc203c35540f99ffa4d770f1279f9', 'request_id': 'req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.527120 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cbc203c35540f99ffa4d770f1279f9', 'request_id': 'req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.533429 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cbc203c35540f99ffa4d770f1279f9', 'request_id': 'req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.543337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] The token cache is being invalidate because project c0cbc203c35540f99ffa4d770f1279f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:15.543620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.544518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.546026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1299/2597] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:15 2022] DELETE /identity/v3/projects/c0cbc203c35540f99ffa4d770f1279f9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:15.550658 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:15.560521 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bcff4-f594-4e8f-a749-3e7a890f93bd service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:15.610424 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:15.617589 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:15.618467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:15.619069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:15.619431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] PATH_INFO: `/v3/users/2ac5a363a22445bc995db146c897e87b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:15.620965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac5a363a22445bc995db146c897e87b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:15.623209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:15.680004 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac5a363a22445bc995db146c897e87b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.687098 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac5a363a22445bc995db146c897e87b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.688271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac5a363a22445bc995db146c897e87b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.695085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac5a363a22445bc995db146c897e87b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.706464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-60df48da-9a45-4c44-a158-1775fce88814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac5a363a22445bc995db146c897e87b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:15.712212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1299/2598] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:15 2022] DELETE /identity/v3/users/2ac5a363a22445bc995db146c897e87b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:15.982934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:15.985094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:16.001934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6f4d2-44e7-4c96-ba20-ffca757a009b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.059445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.060350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.060633 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.060910 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] PATH_INFO: `/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.062109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c0f98dc81d4e28b5b87e427fdb0c8b)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.064034 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.114855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c0f98dc81d4e28b5b87e427fdb0c8b', 'request_id': 'req-1a671b51-2b9c-4ffd-8258-4bf886c733fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:16.122188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c0f98dc81d4e28b5b87e427fdb0c8b', 'request_id': 'req-1a671b51-2b9c-4ffd-8258-4bf886c733fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:16.128532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c0f98dc81d4e28b5b87e427fdb0c8b', 'request_id': 'req-1a671b51-2b9c-4ffd-8258-4bf886c733fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:16.130859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:16.142619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] The token cache is being invalidate because project 47c0f98dc81d4e28b5b87e427fdb0c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:16.143194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:16.143898 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a671b51-2b9c-4ffd-8258-4bf886c733fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:16.145556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1300/2599] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:15 2022] DELETE /identity/v3/projects/47c0f98dc81d4e28b5b87e427fdb0c8b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:16.150542 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.150835 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.151115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.171011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:16.172874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:16.239528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1300/2600] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:16.247062 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.247353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.247661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.266535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:16.267732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:16.275612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1301/2601] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:16.279742 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.290023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42532c6-674f-44ca-be3e-ea45d9b55f05 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.294539 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.295174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.295453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.295726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.296517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:16.296824 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.298405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.309915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1301/2602] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:21:16.314009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.323097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23adbb-38e8-427a-9740-5b62052a8a07 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.328309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.328951 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.329242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.329518 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.330204 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.332108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.357276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1302/2603] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:16 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:16.361226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.371104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856395-5af2-4524-b040-52b970b982dc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.425863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.426516 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.426794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.427066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.427745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.429675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.438853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:16.452254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1302/2604] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:16 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:16.456782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.466992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe69a3-5572-4d15-a40c-175ecb10aa67 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.471599 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.472275 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.472556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.472831 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.473553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.475125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.485814 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1303/2605] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:16.489706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.499436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa579f-8d3f-4786-8c98-30628f9fb3a2 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.504666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.505321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.505607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.505881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.506602 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.508266 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded4733-d733-4ec2-80c5-bb6039eea78a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.518259 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1303/2606] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:16.522198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.532448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fa918-5b54-4d87-8ae7-c206e2bd62bd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.537041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.537928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.538212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.538488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] PATH_INFO: `/v3/projects/33666dc5c1574974bc68f0fd2e500a81/users/944a91c30c254ae7926605ce603f831e/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.553186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33666dc5c1574974bc68f0fd2e500a81, user_id=944a91c30c254ae7926605ce603f831e, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.555797 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.568460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1304/2607] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:16 2022] PUT /identity/v3/projects/33666dc5c1574974bc68f0fd2e500a81/users/944a91c30c254ae7926605ce603f831e/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:16.573610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2937d-6e1c-46de-b133-945945be469f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.574095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2937d-6e1c-46de-b133-945945be469f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.574226 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2937d-6e1c-46de-b133-945945be469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.591562 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e6f2937d-6e1c-46de-b133-945945be469f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:16.592807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e6f2937d-6e1c-46de-b133-945945be469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:16.651075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1304/2608] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:16.661289 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:16.663045 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:16.729830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d09b1-3177-44d3-ac6b-2c2fcbe77606 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:16.733538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:16.734753 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:16.735035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:16.735313 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:16.744335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:16.745744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:16.755123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1305/2609] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:17.420375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.420767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.421081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.450473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] MFA Rules not processed for user `944a91c30c254ae7926605ce603f831e`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:17.451885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:17.518162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1305/2610] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:17.522766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.535000 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6ec3-094e-40e0-bd4f-3fe2caf6fc29 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.539526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.540205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.540491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.540771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.541538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.543576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.571613 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1306/2611] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:17 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:17.575726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.587509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e223d9-c7ae-48ef-be2d-dd8212a4b3e6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.642505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.643154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.643432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.643702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.644404 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.646308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.666001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1306/2612] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:17 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:17.670013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.680763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0894d-0ba0-487d-8364-210d2618e689 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.685334 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.685989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.686274 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.686552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.687806 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.689415 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.701069 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1307/2613] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:17.704917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.710034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:17.716715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9783e49-f61a-45cc-8434-77d0b9b8eb5b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.729627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.730530 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.730815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.731095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] PATH_INFO: `/v3/projects/878bfe43d3d74e1f9e78b98228f263c5/users/f668a471180c4d45b7eea299e0cc2d5b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.746552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878bfe43d3d74e1f9e78b98228f263c5, user_id=f668a471180c4d45b7eea299e0cc2d5b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.749476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.762586 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1307/2614] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:17 2022] PUT /identity/v3/projects/878bfe43d3d74e1f9e78b98228f263c5/users/f668a471180c4d45b7eea299e0cc2d5b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:17.766918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.776734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4863153-8725-4ad6-8cfc-59dc5ac860a4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.825940 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:17.832773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.833474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.833894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.834527 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.835442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.837242 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c3efa-677d-4632-8cb9-2f6591beaed1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.847582 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1308/2615] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:17.851741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:17.862440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd51c-bb90-4d20-bb6a-7b560f3f5c76 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:17.867110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:17.868024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:17.868308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:17.868583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] PATH_INFO: `/v3/projects/878bfe43d3d74e1f9e78b98228f263c5/users/f668a471180c4d45b7eea299e0cc2d5b/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:17.870540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878bfe43d3d74e1f9e78b98228f263c5, user_id=f668a471180c4d45b7eea299e0cc2d5b, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:17.873234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:17.884191 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1308/2616] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:17 2022] PUT /identity/v3/projects/878bfe43d3d74e1f9e78b98228f263c5/users/f668a471180c4d45b7eea299e0cc2d5b/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:18.826442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:18.826955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:18.827051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:18.853635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] MFA Rules not processed for user `f668a471180c4d45b7eea299e0cc2d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:18.855094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:18.929245 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1309/2617] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:18.942101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:18.943976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:19.007055 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f2046-dc3b-469f-84cf-c999571fa2d6 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:19.013488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:19.014112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:19.014662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:19.014938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:19.076024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:19.077464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:19.087762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1309/2618] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:20.444866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:20.459729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5e906-7751-4ee2-b339-7309976f9632 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:20.465125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:20.466363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:20.466363 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:20.466587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:20.477389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:20.479021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b364-ee69-4826-b42e-8a7d61574214 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:20.490425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1310/2619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:21.082785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:21.084706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:21.152585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07779-c2db-431c-a8f4-28d15fa46c18 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:21.157216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:21.158117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:21.158399 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:21.158679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] PATH_INFO: `/v3/users/0cade86fc9394e938f883b148a8a339f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:21.159983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cade86fc9394e938f883b148a8a339f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:21.161904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:21.183141 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:21.208576 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cade86fc9394e938f883b148a8a339f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.216253 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cade86fc9394e938f883b148a8a339f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.216881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cade86fc9394e938f883b148a8a339f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.224867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cade86fc9394e938f883b148a8a339f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.238834 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cade86fc9394e938f883b148a8a339f'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.245826 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1310/2620] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:21 2022] DELETE /identity/v3/users/0cade86fc9394e938f883b148a8a339f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:21.250939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:21.251312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:21.251597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:21.270907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:21.272144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:21.329705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1311/2621] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:21.339070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:21.340505 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:21.398053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dc59f-f2c7-47cd-8a5e-bffd9131eca3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:21.401706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:21.402340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:21.402673 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:21.402895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:21.411845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:21.413280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:21.423102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1311/2622] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:21.684058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:21.685548 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:21.698956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27fe8-ec00-4acc-8c32-54bcb79ea9b6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:21.703935 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:21.704918 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:21.705388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:21.705662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] PATH_INFO: `/v3/projects/0c4b9ab45d8943dca595b0c4058af423` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:21.707746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4b9ab45d8943dca595b0c4058af423)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:21.709677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:21.771850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4b9ab45d8943dca595b0c4058af423', 'request_id': 'req-e4c752ce-0f74-47a1-90a1-5207336f64c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.780550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4b9ab45d8943dca595b0c4058af423', 'request_id': 'req-e4c752ce-0f74-47a1-90a1-5207336f64c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.787872 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4b9ab45d8943dca595b0c4058af423', 'request_id': 'req-e4c752ce-0f74-47a1-90a1-5207336f64c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.789254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:21.803560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] The token cache is being invalidate because project 0c4b9ab45d8943dca595b0c4058af423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:21.804157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.805492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.807398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1312/2623] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:21 2022] DELETE /identity/v3/projects/0c4b9ab45d8943dca595b0c4058af423 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:21.811464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:21.821625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f704437-bf07-46b7-8b67-3dad7fc1512c service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:21.892792 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:21.893758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:21.894134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:21.895216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] PATH_INFO: `/v3/users/9c41f55f6f1548899d0a8d98b9487d15` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:21.896346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c41f55f6f1548899d0a8d98b9487d15)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:21.898943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:21.960864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:21.964317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c41f55f6f1548899d0a8d98b9487d15'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.981930 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c41f55f6f1548899d0a8d98b9487d15'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.983185 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c41f55f6f1548899d0a8d98b9487d15'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:21.992555 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c41f55f6f1548899d0a8d98b9487d15'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.008866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5bb09d86-a993-4221-8c28-c2cc2d66c1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c41f55f6f1548899d0a8d98b9487d15'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.024817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1312/2624] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:21 2022] DELETE /identity/v3/users/9c41f55f6f1548899d0a8d98b9487d15 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:22.371021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.374957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:22.401692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c752ce-0f74-47a1-90a1-5207336f64c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.470858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.471746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.472052 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.472335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] PATH_INFO: `/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.473543 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cfa9d5c8bc4907af647ca3cb472bbe)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.475488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.522494 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cfa9d5c8bc4907af647ca3cb472bbe', 'request_id': 'req-93cbc091-1465-4a90-b16c-986440a40562'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.529995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cfa9d5c8bc4907af647ca3cb472bbe', 'request_id': 'req-93cbc091-1465-4a90-b16c-986440a40562'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.538157 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cfa9d5c8bc4907af647ca3cb472bbe', 'request_id': 'req-93cbc091-1465-4a90-b16c-986440a40562'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.551208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] The token cache is being invalidate because project 20cfa9d5c8bc4907af647ca3cb472bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:22.551724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.552716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-93cbc091-1465-4a90-b16c-986440a40562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:22.554256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1313/2625] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:22 2022] DELETE /identity/v3/projects/20cfa9d5c8bc4907af647ca3cb472bbe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:22.559211 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.559715 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.560028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.581036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:22.582242 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:22.644789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1313/2626] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:22.652758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.653051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.653326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.672110 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:22.673931 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:22.681944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1314/2627] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:22.686519 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.696928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b4ff3-b2ba-4425-a309-4097298398fa None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.702528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.703805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.704111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.704385 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.705116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:22.705420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.707027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.720754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1314/2628] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:22.725061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.734416 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeda64-2c8b-46e6-a1fe-2a8524854957 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.739151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.739799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.740123 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.740403 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.741111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.743020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.769409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1315/2629] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:22 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:22.773503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.783447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8cd3-22d9-44ae-83c7-e7de2ec7d28a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.838120 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.838796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.839077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.839350 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.840084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.842046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.860717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1315/2630] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:22 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:22.864838 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.875467 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a94da-63bf-4ee9-a801-937e003af5b4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.880702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.881586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.881925 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.882266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.883125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.884742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.897121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1316/2631] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:22.901021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.911251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65598669-3198-439a-9ca0-c9da085442a5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.915976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.916773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.917052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.917328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.918050 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.919644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d4d96-3363-4dc5-87ca-35483af5c88c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.930013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1316/2632] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:22.933988 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:22.944639 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614101-8c91-4bb3-8fc7-5fb7bfc4e9f6 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:22.951061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:22.952103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.952397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.952802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] PATH_INFO: `/v3/projects/94c9c625d97949fd9441df7863c1aead/users/98041217840548b5a3521d98fa8d6fc0/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:22.967782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c9c625d97949fd9441df7863c1aead, user_id=98041217840548b5a3521d98fa8d6fc0, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:22.970475 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:22.982962 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1317/2633] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:22 2022] PUT /identity/v3/projects/94c9c625d97949fd9441df7863c1aead/users/98041217840548b5a3521d98fa8d6fc0/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:22.995017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:22.995310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:22.995595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.022198 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] MFA Rules not processed for user `98041217840548b5a3521d98fa8d6fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:23.023407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:23.035614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:23.090275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1317/2634] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:23.094698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.113086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:23.174224 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926c28-a7dd-4472-a31d-87ff421ccf27 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.179147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.179802 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.180109 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.180387 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.181085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.182974 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.214519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1318/2635] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:23.215913 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.226936 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc017c8d-f20a-424a-80af-186b9af01e5e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.288320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.288989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.289284 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.289547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.290507 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.292510 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.328019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1318/2636] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:23 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:23.330547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.341997 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707ada9-de98-4f25-b135-e90277e35cae admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.347310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.348020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.348295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.348573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.349307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.350889 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.364353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1319/2637] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:23.368298 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.378948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dcf3-a677-411a-b54f-f8566472c329 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.385311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.386237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.386597 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.386972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.387703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.389970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482db09a-4ace-49b4-ad4d-a40c1a624fa9 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.402509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1319/2638] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:23.407211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.418413 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a4020-9cef-4ac9-bae6-a4ff41958061 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.424152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.425106 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.425454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.425794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] PATH_INFO: `/v3/projects/4089a8fc6138428aa50391aa53a53579/users/3ecd387c176245dfb5d461e88b970bae/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.442367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4089a8fc6138428aa50391aa53a53579, user_id=3ecd387c176245dfb5d461e88b970bae, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.445053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.462331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1320/2639] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:23 2022] PUT /identity/v3/projects/4089a8fc6138428aa50391aa53a53579/users/3ecd387c176245dfb5d461e88b970bae/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:23.474257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.474620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.474905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.510979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] MFA Rules not processed for user `3ecd387c176245dfb5d461e88b970bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:23.510979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:23.610075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1320/2640] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:23.614407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.674983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046130b-fde7-44cb-94c8-ede5ee41386c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.679608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.680293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.680578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.680856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.681553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.683422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.708046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1321/2641] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:23 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:23.712177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.723364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf929081-6aa4-44ec-a09d-bef0894dd0f4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.742540 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:23.780179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.780843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.781666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.781939 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.782628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.784557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.803179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1321/2642] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:23 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:23.807102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.817483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78ce6-af9f-4961-9291-2689221ba1f1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.822023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.822688 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.822948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.823220 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.823980 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.825577 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.836800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1322/2643] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:23.840701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.851236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49f19a-6e11-437e-9a9a-0b170ba3874e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.855887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.856793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.857059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.857338 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] PATH_INFO: `/v3/projects/f934689d3d404a90ba914ae033574d49/users/86e71c9cf4dc43bbab25ebf299c296e4/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.872292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f934689d3d404a90ba914ae033574d49, user_id=86e71c9cf4dc43bbab25ebf299c296e4, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.875166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.887470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1322/2644] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:23 2022] PUT /identity/v3/projects/f934689d3d404a90ba914ae033574d49/users/86e71c9cf4dc43bbab25ebf299c296e4/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:23.892192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.902043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05709ed-0fd8-451f-9653-661f3bf06f03 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:23.943843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:23.965449 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:23.966208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:23.966500 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:23.966803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:23.967528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:23.969732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6ec1b-b348-474d-9347-9427439764bc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:23.980205 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1323/2645] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:23.984631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:23.995527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d52e7-2856-456b-885d-fb2709bc411a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:24.000494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:24.001392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:24.001681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:24.001965 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] PATH_INFO: `/v3/projects/f934689d3d404a90ba914ae033574d49/users/86e71c9cf4dc43bbab25ebf299c296e4/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:24.004044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f934689d3d404a90ba914ae033574d49, user_id=86e71c9cf4dc43bbab25ebf299c296e4, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:24.006948 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:24.018689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1323/2646] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:23 2022] PUT /identity/v3/projects/f934689d3d404a90ba914ae033574d49/users/86e71c9cf4dc43bbab25ebf299c296e4/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:24.033206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:24.033496 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:24.033775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:24.059509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] MFA Rules not processed for user `86e71c9cf4dc43bbab25ebf299c296e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:24.060750 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:24.129119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1324/2647] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:24.141488 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:24.143154 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:24.202306 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0242f-65de-4e04-b1a1-9f2d2ee266ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:24.206525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:24.207166 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:24.207446 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:24.207721 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:24.272485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:24.273808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:24.284219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1324/2648] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:25.840026 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:25.850294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3934e42-100a-48e8-9894-271605f71f81 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:25.854490 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:25.855218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:25.855629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:25.856032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:25.944942 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:25.950906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:25.989471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1325/2649] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:26.649221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:26.658989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344b43f-df28-4167-8135-af650ddf49d2 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:26.663209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:26.663920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:26.664168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:26.664443 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:26.675627 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:26.677369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40948971-98aa-498f-b02d-f41ab55085b3 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:26.688346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1325/2650] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:28.904235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:28.905644 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:28.972442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189649ec-1ca7-4b9b-bc95-7c5945f9306c service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:28.977042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:28.977979 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:28.978263 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:28.978549 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] PATH_INFO: `/v3/users/f62089f4d379446382480528acac4ef8` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:28.979704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62089f4d379446382480528acac4ef8)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:28.981635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:28.983096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:29.028640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62089f4d379446382480528acac4ef8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.035669 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62089f4d379446382480528acac4ef8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.036314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62089f4d379446382480528acac4ef8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.036916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62089f4d379446382480528acac4ef8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.043696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62089f4d379446382480528acac4ef8'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.060955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1326/2651] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:28 2022] DELETE /identity/v3/users/f62089f4d379446382480528acac4ef8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:29.065565 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:29.066046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:29.066164 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:29.084006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:29.085257 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:29.098931 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:29.148693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1326/2652] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:29.158818 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:29.160251 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:29.223005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13b13b-05ff-48ee-a50b-bb957d11aa99 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:29.227914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:29.228466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:29.228742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:29.229021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:29.239183 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:29.240863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:29.252262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1327/2653] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:29.549992 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:29.551514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:29.567255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c8470-d88f-411f-bb73-d91a3bdd4687 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:29.572461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:29.573325 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:29.573613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:29.575268 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] PATH_INFO: `/v3/projects/ff1a312d7b1e4059927c1caeeb7f63b2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:29.576822 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1a312d7b1e4059927c1caeeb7f63b2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:29.583909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:29.640413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1a312d7b1e4059927c1caeeb7f63b2', 'request_id': 'req-e0a2df99-fc09-4af6-8bec-9fc530db57bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.648962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1a312d7b1e4059927c1caeeb7f63b2', 'request_id': 'req-e0a2df99-fc09-4af6-8bec-9fc530db57bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.655289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1a312d7b1e4059927c1caeeb7f63b2', 'request_id': 'req-e0a2df99-fc09-4af6-8bec-9fc530db57bb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.667552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] The token cache is being invalidate because project ff1a312d7b1e4059927c1caeeb7f63b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:29.668400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.668766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.670389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1327/2654] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:29 2022] DELETE /identity/v3/projects/ff1a312d7b1e4059927c1caeeb7f63b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:29.675312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:29.684967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee7caa-acb6-491f-a05b-c21c9cdbdb4b service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:29.742634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:29.743493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:29.743779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:29.744140 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] PATH_INFO: `/v3/users/dd9d1f96ae2f42568d2cc74231456ba5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:29.745314 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9d1f96ae2f42568d2cc74231456ba5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:29.747238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:29.770218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:29.793971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9d1f96ae2f42568d2cc74231456ba5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.801636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9d1f96ae2f42568d2cc74231456ba5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.802371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9d1f96ae2f42568d2cc74231456ba5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.803035 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9d1f96ae2f42568d2cc74231456ba5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.810231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1f408813-7b23-48f6-9926-cac487984ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9d1f96ae2f42568d2cc74231456ba5'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:29.827445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1328/2655] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:29 2022] DELETE /identity/v3/users/dd9d1f96ae2f42568d2cc74231456ba5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:30.106553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.108069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.121667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2df99-fc09-4af6-8bec-9fc530db57bb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.185887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.186672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.186960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.187234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] PATH_INFO: `/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.188432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fd9624c6b34a9d9f4bab04c08100bf)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.190340 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.231633 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:30.236367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fd9624c6b34a9d9f4bab04c08100bf', 'request_id': 'req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.246126 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fd9624c6b34a9d9f4bab04c08100bf', 'request_id': 'req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.252492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fd9624c6b34a9d9f4bab04c08100bf', 'request_id': 'req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.263094 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] The token cache is being invalidate because project 81fd9624c6b34a9d9f4bab04c08100bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:30.263375 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.264035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-4c3485f0-b709-46a5-bb4e-d01edef9e5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.266177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1328/2656] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:30 2022] DELETE /identity/v3/projects/81fd9624c6b34a9d9f4bab04c08100bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:30.271096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.271646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.271646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.290369 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:30.291566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.349194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1329/2657] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:30.357816 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.358107 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.358387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.379733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:30.381006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.389536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1329/2658] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:30.394194 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.403764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3d809-ba9c-4169-ab0d-845877d9f5cb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.408963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.409601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.409884 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.410155 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.410871 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:30.411174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.412776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.424073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1330/2659] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:30.428015 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.437210 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760809e-aae0-4135-b7ec-4fa575e242f7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.442475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.443457 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.443740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.444049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.444726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.446920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.474038 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1330/2660] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:30.477795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.487528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471eec-99e3-4a4d-9ead-c1e585470977 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.543990 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.544662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.544943 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.545218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.545900 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.547812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.571114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1331/2661] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:30.572528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.579540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.581296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.583946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8bc95-592d-4c48-8c19-892286fecaeb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.588698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.589388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.589697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.589972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.590696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.592345 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.592939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400df70-172a-42d6-8fb7-145e2c1907c2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.598240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.599099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.599404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.599713 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] PATH_INFO: `/v3/users/98041217840548b5a3521d98fa8d6fc0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.600932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98041217840548b5a3521d98fa8d6fc0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.602850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.603613 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1331/2662] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:30.607444 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.616914 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:30.619093 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6a80-4493-4ab1-b39a-866b408fa9cb admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.624321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.625049 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.625844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.626119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.626837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.628491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.642035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1332/2663] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:30.644074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.658085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98041217840548b5a3521d98fa8d6fc0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.660595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f7810-b066-4898-a3d0-86612ccc4e89 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.666855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.668345 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98041217840548b5a3521d98fa8d6fc0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.668621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.668892 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.669173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98041217840548b5a3521d98fa8d6fc0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.669296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] PATH_INFO: `/v3/projects/609ff86454074dfbaf4824e66c911395/users/97524523875d432f893b7e4ed5446e39/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.670040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98041217840548b5a3521d98fa8d6fc0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.678085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-14f84c90-03c6-4dd4-ad1a-30d7b7990421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98041217840548b5a3521d98fa8d6fc0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:30.691216 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ff86454074dfbaf4824e66c911395, user_id=97524523875d432f893b7e4ed5446e39, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.696148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f15f-f20e-48e4-ab83-f7b7fe9e0aa5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.702356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1332/2664] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:30 2022] DELETE /identity/v3/users/98041217840548b5a3521d98fa8d6fc0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:30.713097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.713529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.714065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.724868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1333/2665] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:30 2022] PUT /identity/v3/projects/609ff86454074dfbaf4824e66c911395/users/97524523875d432f893b7e4ed5446e39/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:30.726663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.726811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.727194 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.732879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:30.734206 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.757777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] MFA Rules not processed for user `97524523875d432f893b7e4ed5446e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:30.758986 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.798471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1333/2666] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:30.808857 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.810883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.833588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1334/2667] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:30.837846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.839397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:30.854679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2ee3-a5e5-45b8-914b-77fc2a82d2f5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.860322 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.860978 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.861262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.861543 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.862241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.864162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.882711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109794e2-7192-4f26-974c-ddb49d3c3195 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.888486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.889535 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.889850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.890497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.895663 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1335/2668] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:30.899691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:30.901734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.903208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:30.913907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1334/2669] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:30.944051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:30.985614 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d11e5-4602-4809-9c9b-f9d1b99c4965 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:30.991193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:30.991903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:30.992201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:30.992984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:30.993679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:30.995726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.021889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1336/2670] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:30 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:31.025586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.038842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0cd10-453c-4aea-82a1-58a3af331a8a service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.045175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.045843 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.046213 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.046495 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.048016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.049787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.061354 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1335/2671] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:31.065981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.076215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386376-0284-4544-bae9-bc839b7ee7c8 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.081712 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.082453 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.083220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.083220 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] PATH_INFO: `/v3/projects/28be948de15044448e83cca38c30b0ac/users/3a3ed9c80e874f5b8f1b52900b8d0efa/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.100741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28be948de15044448e83cca38c30b0ac, user_id=3a3ed9c80e874f5b8f1b52900b8d0efa, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.103461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.126011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1337/2672] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:31 2022] PUT /identity/v3/projects/28be948de15044448e83cca38c30b0ac/users/3a3ed9c80e874f5b8f1b52900b8d0efa/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:31.129967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.140414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e818e-b6a4-480a-9382-9c7f4bbf4979 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.160176 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:31.200397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.200989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.201271 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.201541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.202255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.204397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.215159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1336/2673] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:31.220024 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.231065 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4ac4-8f26-4384-a2fb-fbe27e2c086e admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.236687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.237573 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.237854 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.238130 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] PATH_INFO: `/v3/projects/28be948de15044448e83cca38c30b0ac/users/3a3ed9c80e874f5b8f1b52900b8d0efa/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.240175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28be948de15044448e83cca38c30b0ac, user_id=3a3ed9c80e874f5b8f1b52900b8d0efa, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.243048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc2a9d-4d79-45f8-9e03-b8d31ed5d90f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.244107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.246402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.254248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1338/2674] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:31 2022] PUT /identity/v3/projects/28be948de15044448e83cca38c30b0ac/users/3a3ed9c80e874f5b8f1b52900b8d0efa/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:31.259746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7c15c-ad4c-4e68-8534-8ffe14c65cfd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.266518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.266921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.267304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.295699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] MFA Rules not processed for user `3a3ed9c80e874f5b8f1b52900b8d0efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:31.297096 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.319542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.320438 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.320716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.320989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] PATH_INFO: `/v3/projects/94c9c625d97949fd9441df7863c1aead` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.322173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c9c625d97949fd9441df7863c1aead)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.324098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.372970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1339/2675] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:31.375761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c9c625d97949fd9441df7863c1aead', 'request_id': 'req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.383083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c9c625d97949fd9441df7863c1aead', 'request_id': 'req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.383949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.385497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.390125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c9c625d97949fd9441df7863c1aead', 'request_id': 'req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.401232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] The token cache is being invalidate because project 94c9c625d97949fd9441df7863c1aead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:31.401519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.402170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.404087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1337/2676] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:31 2022] DELETE /identity/v3/projects/94c9c625d97949fd9441df7863c1aead => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:31.408405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.409734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.442993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685450d5-9dfe-4926-85d7-696c2e6a416f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.455850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:31.460166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:31.477629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6dff8-f4a0-46ca-b617-cf9b0aae021a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.483145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.484055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.484384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.484658 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] PATH_INFO: `/v3/users/3ecd387c176245dfb5d461e88b970bae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.485848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecd387c176245dfb5d461e88b970bae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.487758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.496490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.497135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.497418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.497694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.499501 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.537254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecd387c176245dfb5d461e88b970bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.545299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecd387c176245dfb5d461e88b970bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.545947 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecd387c176245dfb5d461e88b970bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.546570 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecd387c176245dfb5d461e88b970bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.553603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecd387c176245dfb5d461e88b970bae'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:31.565937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.567384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:31.574513 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1338/2677] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:31 2022] DELETE /identity/v3/users/3ecd387c176245dfb5d461e88b970bae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:31.577871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1340/2678] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:31.861815 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:31.863249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:31.947642 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd49cb-8105-480e-b265-74dcf09da088 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:31.953909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:31.954260 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:31.954557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:31.954833 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] PATH_INFO: `/v3/projects/4089a8fc6138428aa50391aa53a53579` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:31.956054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4089a8fc6138428aa50391aa53a53579)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:31.957964 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:32.015116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4089a8fc6138428aa50391aa53a53579', 'request_id': 'req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.030963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4089a8fc6138428aa50391aa53a53579', 'request_id': 'req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.039191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4089a8fc6138428aa50391aa53a53579', 'request_id': 'req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.047389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:32.052731 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] The token cache is being invalidate because project 4089a8fc6138428aa50391aa53a53579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:32.055511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.060223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.062031 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1339/2679] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:31 2022] DELETE /identity/v3/projects/4089a8fc6138428aa50391aa53a53579 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:32.066616 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:32.078358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3f30d-3870-4645-bda7-2f2cba9e6cfd service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:32.140388 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:32.144265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:32.144265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:32.144265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] PATH_INFO: `/v3/users/86e71c9cf4dc43bbab25ebf299c296e4` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:32.144265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e71c9cf4dc43bbab25ebf299c296e4)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:32.145768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:32.201245 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e71c9cf4dc43bbab25ebf299c296e4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.216607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e71c9cf4dc43bbab25ebf299c296e4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.217353 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e71c9cf4dc43bbab25ebf299c296e4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.225405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e71c9cf4dc43bbab25ebf299c296e4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.231122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:32.241034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ce5afdfd-4669-4f5e-ab0c-b6a38a93c709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e71c9cf4dc43bbab25ebf299c296e4'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.248583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1341/2680] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:32 2022] DELETE /identity/v3/users/86e71c9cf4dc43bbab25ebf299c296e4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:32.574812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:32.577053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:32.599038 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd845-93c4-48f9-a4c1-cf18e5ab0da9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:32.693356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:32.694454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:32.694736 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:32.695006 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] PATH_INFO: `/v3/projects/f934689d3d404a90ba914ae033574d49` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:32.696848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f934689d3d404a90ba914ae033574d49)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:32.698794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:32.776055 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f934689d3d404a90ba914ae033574d49', 'request_id': 'req-cfe2ed3f-c3be-4353-954f-18572fe518e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.785279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f934689d3d404a90ba914ae033574d49', 'request_id': 'req-cfe2ed3f-c3be-4353-954f-18572fe518e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.793835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f934689d3d404a90ba914ae033574d49', 'request_id': 'req-cfe2ed3f-c3be-4353-954f-18572fe518e1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.805835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] The token cache is being invalidate because project f934689d3d404a90ba914ae033574d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:32.806080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.806764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-cfe2ed3f-c3be-4353-954f-18572fe518e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:32.808356 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1340/2681] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:32 2022] DELETE /identity/v3/projects/f934689d3d404a90ba914ae033574d49 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:32.813653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:32.813957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:32.814224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:32.833907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:32.835135 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:32.909293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1342/2682] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:32.978778 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:32.979237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:32.979634 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:32.999957 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:33.001824 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.010631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1341/2683] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:33.015605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.027416 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e714-c882-45af-a72f-7672acee1d14 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.033796 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.034463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.034747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.035018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.035743 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:33.036073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.037666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.052429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1343/2684] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:33.056994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.066950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603aaab-b1e1-4150-8d92-3d7aa87cf6f0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.072315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.072976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.073256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.073546 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.074252 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.076191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.106953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1342/2685] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:33 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:33.112149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.113859 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.115783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.122745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72994c86-c58c-4282-b3e3-f3d361ae4c92 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.182346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25defebe-77e3-41dc-a200-33fac0bd6d10 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.187058 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.187992 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.188278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.188553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] PATH_INFO: `/v3/users/97524523875d432f893b7e4ed5446e39` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.188958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.189635 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.189782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97524523875d432f893b7e4ed5446e39)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.189918 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.190187 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.191117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.191696 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.193409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:33.194912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.220292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1344/2686] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:33.224218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.236017 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4cbc-c7d2-4a54-97ca-dfb88c6ba782 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.242110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.242777 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.243058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.243223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97524523875d432f893b7e4ed5446e39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.243336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.244140 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.245774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.252630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97524523875d432f893b7e4ed5446e39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.253398 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97524523875d432f893b7e4ed5446e39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.254370 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97524523875d432f893b7e4ed5446e39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.257466 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1345/2687] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:33.262863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.265081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.265286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-0e81425f-49df-4eaa-902b-8bbb85562001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97524523875d432f893b7e4ed5446e39'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.279617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0293b7-5040-4d4f-8fa8-ca80b038b1f7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.285172 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1343/2688] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:33 2022] DELETE /identity/v3/users/97524523875d432f893b7e4ed5446e39 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:33.285396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.286168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.286421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.286701 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.287429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.289324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.289536 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.289826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.290100 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.301595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1346/2689] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:33.306076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.311040 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:33.312296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.316927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8d6c2-8cb2-4bb2-a887-974866cf6f68 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.361008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:33.373863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1344/2690] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:33.380146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.381075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.381354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.381626 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] PATH_INFO: `/v3/projects/6c5c62ab1df34035bac5059ea6242475/users/ab97824a4b634733af874f3c4a978829/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.384297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.385740 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.400554 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5c62ab1df34035bac5059ea6242475, user_id=ab97824a4b634733af874f3c4a978829, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.403189 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff28a6-2d60-4086-8170-b56d9021462f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.417149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1347/2691] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:33 2022] PUT /identity/v3/projects/6c5c62ab1df34035bac5059ea6242475/users/ab97824a4b634733af874f3c4a978829/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:33.427753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.428070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.428336 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.451682 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808a9f-2b53-456b-ae53-912b59dd094f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.456173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] MFA Rules not processed for user `ab97824a4b634733af874f3c4a978829`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:33.457447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.487032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:33.516953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.517620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.517907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.518189 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.529367 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1348/2692] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:33.542278 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.543674 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.581421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.582855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.592893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1345/2693] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:33.599598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633389d7-0ccd-4e26-8b20-9126b49ec934 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.603311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.604000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.604280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.604552 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.613637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.615067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f8f06-565a-4b8a-91f0-3e653cef8577 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.623940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1349/2694] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:33.649301 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.659994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77feb7-ee1b-40a8-be05-e33e096ee081 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.665086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.665978 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.666236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.666578 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] PATH_INFO: `/v3/users/ab97824a4b634733af874f3c4a978829` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.667907 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab97824a4b634733af874f3c4a978829)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.670074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.719279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab97824a4b634733af874f3c4a978829'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.726773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab97824a4b634733af874f3c4a978829'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.727454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab97824a4b634733af874f3c4a978829'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.728152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab97824a4b634733af874f3c4a978829'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.736179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab97824a4b634733af874f3c4a978829'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:33.760795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1346/2695] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:33 2022] DELETE /identity/v3/users/ab97824a4b634733af874f3c4a978829 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:33.762517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.762905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.763348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.783251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:33.784529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.849382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:33.860968 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1350/2696] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:33.870700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.874193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.920679 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:33.923119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:33.937300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f34b-f451-41d8-aeaf-f41d100e11ca None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.945349 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6293-f8e4-460a-908e-07a098c85234 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:33.949459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.950113 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.950390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.950662 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.956088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:33.956974 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:33.957265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:33.957545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] PATH_INFO: `/v3/projects/609ff86454074dfbaf4824e66c911395` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:33.959260 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=609ff86454074dfbaf4824e66c911395)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.961316 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.963916 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:33.965459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:33.971366 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:33.977913 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1347/2697] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:34.013108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609ff86454074dfbaf4824e66c911395', 'request_id': 'req-c9138446-3a03-44cb-b439-669caf3fc28a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.023907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609ff86454074dfbaf4824e66c911395', 'request_id': 'req-c9138446-3a03-44cb-b439-669caf3fc28a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.030293 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609ff86454074dfbaf4824e66c911395', 'request_id': 'req-c9138446-3a03-44cb-b439-669caf3fc28a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.040745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] The token cache is being invalidate because project 609ff86454074dfbaf4824e66c911395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:34.041387 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.042139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.043941 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1351/2698] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:33 2022] DELETE /identity/v3/projects/609ff86454074dfbaf4824e66c911395 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:34.048431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:34.061352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59540-faf6-4299-a4dc-129cc47e01e4 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:34.130567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:34.131444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:34.131728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:34.132039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] PATH_INFO: `/v3/users/3a3ed9c80e874f5b8f1b52900b8d0efa` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:34.133258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3ed9c80e874f5b8f1b52900b8d0efa)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:34.135355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:34.188225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3ed9c80e874f5b8f1b52900b8d0efa'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.196683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3ed9c80e874f5b8f1b52900b8d0efa'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.197323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3ed9c80e874f5b8f1b52900b8d0efa'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.197959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3ed9c80e874f5b8f1b52900b8d0efa'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.205061 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3ed9c80e874f5b8f1b52900b8d0efa'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.223629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1348/2699] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:34 2022] DELETE /identity/v3/users/3a3ed9c80e874f5b8f1b52900b8d0efa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:34.676943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:34.678506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:34.693292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9138446-3a03-44cb-b439-669caf3fc28a admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:34.766818 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:34.767850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:34.768156 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:34.768429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] PATH_INFO: `/v3/projects/6c5c62ab1df34035bac5059ea6242475` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:34.773341 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5c62ab1df34035bac5059ea6242475)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:34.778303 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:34.815293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:34.816692 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:34.830563 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7a34-a1bd-4976-8508-d404a5e63c41 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:34.837620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5c62ab1df34035bac5059ea6242475', 'request_id': 'req-329bbe99-85c3-4adb-b550-5f57d1a5f87a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.849452 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5c62ab1df34035bac5059ea6242475', 'request_id': 'req-329bbe99-85c3-4adb-b550-5f57d1a5f87a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.860787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5c62ab1df34035bac5059ea6242475', 'request_id': 'req-329bbe99-85c3-4adb-b550-5f57d1a5f87a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.874682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] The token cache is being invalidate because project 6c5c62ab1df34035bac5059ea6242475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:34.876372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.877111 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-329bbe99-85c3-4adb-b550-5f57d1a5f87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.878788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1352/2700] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:34 2022] DELETE /identity/v3/projects/6c5c62ab1df34035bac5059ea6242475 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:34.884177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b17a9-72ab-4e57-b80b-1e847ac3fde6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:34.884538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b17a9-72ab-4e57-b80b-1e847ac3fde6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:34.884888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b17a9-72ab-4e57-b80b-1e847ac3fde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:34.904458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-681b17a9-72ab-4e57-b80b-1e847ac3fde6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:34.905175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:34.905857 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-681b17a9-72ab-4e57-b80b-1e847ac3fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:34.906070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:34.906352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:34.906629 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] PATH_INFO: `/v3/projects/28be948de15044448e83cca38c30b0ac` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:34.907837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28be948de15044448e83cca38c30b0ac)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:34.909758 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:34.914643 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1353/2701] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:34.922607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:34.922885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:34.923159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:34.931855 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:34.938545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:34.950071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:34.954960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:34.971550 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28be948de15044448e83cca38c30b0ac', 'request_id': 'req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.981032 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28be948de15044448e83cca38c30b0ac', 'request_id': 'req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:34.989330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28be948de15044448e83cca38c30b0ac', 'request_id': 'req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.002246 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] The token cache is being invalidate because project 28be948de15044448e83cca38c30b0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:35.002526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.003196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ed6e3a39-5d84-4d09-b860-d4362c3cb0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.005214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1349/2702] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:34 2022] DELETE /identity/v3/projects/28be948de15044448e83cca38c30b0ac => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:35.010132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a15fc-4c6a-4c85-8aa1-2adc95cc766e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.010489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a15fc-4c6a-4c85-8aa1-2adc95cc766e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.010877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a15fc-4c6a-4c85-8aa1-2adc95cc766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.030013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-861a15fc-4c6a-4c85-8aa1-2adc95cc766e None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:35.031367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-861a15fc-4c6a-4c85-8aa1-2adc95cc766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.039379 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1354/2703] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:35.039896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1350/2704] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:35.040524 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.051399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.051399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.051399 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.051789 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e029-db35-4a46-a4e6-9ad2c4ded0bd None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.056979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.057927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.058221 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.058504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.059251 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:35.059564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.061217 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.070053 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:35.071323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.079566 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1355/2705] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:35.081292 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.081418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1351/2706] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:35.085293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.096100 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d38e7-1a27-4516-a39b-89cf94ca72c1 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.098158 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994069d-d34e-4968-ac55-1fb15625a8e6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.101374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.102036 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.102383 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.102594 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.103291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.103794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.104551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.104903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.105239 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.105352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.106094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:35.106471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.108133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.124125 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1352/2707] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:21:35.127640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.140463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1356/2708] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:35.140701 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad892-9223-4641-9c5c-26da11a1707b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.141587 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.206539 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.207203 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.207492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ad0f-7174-45b9-8316-d02a5b04683f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.207614 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.207768 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.208491 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.210637 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.212646 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.213318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.213604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.213880 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.214662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.216961 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.242084 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1357/2709] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:35.243695 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.243888 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1353/2710] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:35.248024 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.257531 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088a764-c172-4a45-b95e-271db9c99130 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.325471 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227d71-cd89-4c5b-8887-62a7f60f9539 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.325856 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.327168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.327296 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.327661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.328723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.330408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.331225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.332008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.332300 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:35.332445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.332839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.333645 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.335728 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.347705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1358/2711] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:35.351739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.354394 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:35.363029 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531b560-7bcc-4dbc-8960-f623a39db7aa admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.365240 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1354/2712] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:35.366361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.376389 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.377165 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.377427 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.377693 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.378487 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.379318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79e26-144a-4868-9650-f28b6ae6b491 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.380204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.392964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1359/2713] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:35.396296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.396592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.397003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.397287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.397564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.398294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.398407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.399908 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.414253 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1355/2714] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:35.414428 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f64bd-2ddc-4262-8c51-3ff91f37ec36 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.414555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.417805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.418672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.418958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.419232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] PATH_INFO: `/v3/users/944a91c30c254ae7926605ce603f831e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.420504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944a91c30c254ae7926605ce603f831e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.422779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3faeb-d773-4aea-b814-c559a0a564a5 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.423011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.427742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.428724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.429074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.429353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] PATH_INFO: `/v3/projects/15a3c06b3b2d44d18cbc5dd1ed2b4b92/users/3a08577a5f8742e0b6b5c40ce082a441/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.444230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a3c06b3b2d44d18cbc5dd1ed2b4b92, user_id=3a08577a5f8742e0b6b5c40ce082a441, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.446846 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.460826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1356/2715] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:35 2022] PUT /identity/v3/projects/15a3c06b3b2d44d18cbc5dd1ed2b4b92/users/3a08577a5f8742e0b6b5c40ce082a441/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:35.464686 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.477654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944a91c30c254ae7926605ce603f831e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.488344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944a91c30c254ae7926605ce603f831e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.489011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944a91c30c254ae7926605ce603f831e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.496517 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944a91c30c254ae7926605ce603f831e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.508783 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-67d72246-b73f-48e6-8dec-ec099ff7bef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944a91c30c254ae7926605ce603f831e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.515408 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1360/2716] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:35 2022] DELETE /identity/v3/users/944a91c30c254ae7926605ce603f831e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:35.518622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.518622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.518622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.534702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:35.535952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.537433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb49b1-bc62-4f75-81cc-6cfe6dc4b243 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.606611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.607311 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.607596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.607895 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.608623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.610326 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.613085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1361/2717] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:35.621064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1357/2718] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:35.626454 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.627732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.627946 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.629847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.642052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe548f7-9edf-481f-843a-2b62bdacbd41 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.647057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.647997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.648280 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.648606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] PATH_INFO: `/v3/projects/ac5267e72cf94e76a2d54e106369c916/users/22f709712ce74782a79e6c7b50cbafb3/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.665179 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5267e72cf94e76a2d54e106369c916, user_id=22f709712ce74782a79e6c7b50cbafb3, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.667846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee6d32-cd15-4c92-bb17-9dd19d786d9a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.686401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1362/2719] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:35 2022] PUT /identity/v3/projects/ac5267e72cf94e76a2d54e106369c916/users/22f709712ce74782a79e6c7b50cbafb3/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:35.697527 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.697900 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.698209 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.701150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8dcb5-33ba-43d3-8393-b991fd39d268 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.722329 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:35.726628 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] MFA Rules not processed for user `22f709712ce74782a79e6c7b50cbafb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:35.727969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.752753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:35.761074 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.761730 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.762036 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.762312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.803143 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1363/2720] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:35.807640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.808994 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:35.829377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.830720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.840604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1358/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:35.841486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.851571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d049-daa0-4d60-8b09-d3fab9fbb713 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.856368 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.857027 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.857440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.857729 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.858421 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.860995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.881957 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c06e2-26ca-4168-8ab8-511f37459bef None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.887271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:35.888199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:35.888483 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:35.888781 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] PATH_INFO: `/v3/projects/33666dc5c1574974bc68f0fd2e500a81` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:35.890234 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33666dc5c1574974bc68f0fd2e500a81)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:35.890933 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1359/2722] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:35.892271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:35.894825 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.944412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33666dc5c1574974bc68f0fd2e500a81', 'request_id': 'req-5184b124-27f8-425b-af2f-8d00726df7dd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.954066 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33666dc5c1574974bc68f0fd2e500a81', 'request_id': 'req-5184b124-27f8-425b-af2f-8d00726df7dd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.962700 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33666dc5c1574974bc68f0fd2e500a81', 'request_id': 'req-5184b124-27f8-425b-af2f-8d00726df7dd'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.969075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb322a-bf6b-4937-8c55-f748dbb84d45 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:35.976068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] The token cache is being invalidate because project 33666dc5c1574974bc68f0fd2e500a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:35.976329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.977329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:35.981797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1364/2723] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:35 2022] DELETE /identity/v3/projects/33666dc5c1574974bc68f0fd2e500a81 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:35.983061 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:35.984889 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.042681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:36.048866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:36.056899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.057848 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.058231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.058606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.059457 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.061924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.066508 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b124-27f8-425b-af2f-8d00726df7dd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.073962 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.075331 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.075618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.075951 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] PATH_INFO: `/v3/users/f668a471180c4d45b7eea299e0cc2d5b` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.077236 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f668a471180c4d45b7eea299e0cc2d5b)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.079366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.101210 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1360/2724] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:35 2022] POST /identity/v3/users => generated 306 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:36.102278 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.104208 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.116748 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13f2fa-4afc-43a5-b330-0913a85d064e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.121657 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.122316 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.122591 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.122869 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.123593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.125255 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.135870 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1361/2725] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:36.140389 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.148887 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f668a471180c4d45b7eea299e0cc2d5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.153448 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cb84-d86d-4588-ba69-e27d81afa7c3 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.159105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f668a471180c4d45b7eea299e0cc2d5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.159601 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.159927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f668a471180c4d45b7eea299e0cc2d5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.160712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.161175 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.161545 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] PATH_INFO: `/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae/users/235ef2d09d1c4d458414049de4b5061c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.167890 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f668a471180c4d45b7eea299e0cc2d5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.178181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea8052a4924ff1b0eff753144bd3ae, user_id=235ef2d09d1c4d458414049de4b5061c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.181072 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.182814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f668a471180c4d45b7eea299e0cc2d5b'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.191016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1365/2726] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:35 2022] DELETE /identity/v3/users/f668a471180c4d45b7eea299e0cc2d5b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:36.199909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1362/2727] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:36 2022] PUT /identity/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae/users/235ef2d09d1c4d458414049de4b5061c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:36.213085 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.215601 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.315289 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a9ea-5d11-47e7-b715-2f73335beaf5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.384206 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.384989 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.385378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.385800 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.386648 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.388772 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83466897-b7e0-4332-8bd3-7c9a6e204bcd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.401591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1366/2728] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:36.406111 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.419353 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de05e0-d13d-4827-a9fa-eea2f882debe admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.425323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.429134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.429503 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.429860 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] PATH_INFO: `/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae/users/235ef2d09d1c4d458414049de4b5061c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.433414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea8052a4924ff1b0eff753144bd3ae, user_id=235ef2d09d1c4d458414049de4b5061c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.436241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba580ad-291d-4d5f-9194-4c1ea7ad84f7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.452121 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1363/2729] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:36 2022] PUT /identity/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae/users/235ef2d09d1c4d458414049de4b5061c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:36.464150 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.464591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.464972 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.497719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] MFA Rules not processed for user `235ef2d09d1c4d458414049de4b5061c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:36.499152 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.505904 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:36.561307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.561590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.561862 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.592291 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] MFA Rules not processed for user `3a08577a5f8742e0b6b5c40ce082a441`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:36.593782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.599787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1367/2730] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:36.615082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.617817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.694901 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccde8-610d-43dc-bb6f-83d172f88a9c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.700037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.700883 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1364/2731] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:36.701033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.701377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.701786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.712699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.714035 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.714257 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.715482 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.728040 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1368/2732] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:36.733420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.735506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.749698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a675e34-2387-4cb0-a133-344c8a1da509 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.756007 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.756910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.757475 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.757770 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.771812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.773390 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.788843 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1369/2733] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:36.823482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19a5b8-f5b8-41e9-8bcc-5e1622c4529d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.828632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.829641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.830188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.830517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] PATH_INFO: `/v3/projects/878bfe43d3d74e1f9e78b98228f263c5` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.831885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878bfe43d3d74e1f9e78b98228f263c5)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.833903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.834691 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:36.843354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1875e-3e35-42da-90db-18f0cee3b0d2 service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:36.848369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:36.849190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.849550 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.849896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.851940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.872899 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:36.889538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878bfe43d3d74e1f9e78b98228f263c5', 'request_id': 'req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.897844 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878bfe43d3d74e1f9e78b98228f263c5', 'request_id': 'req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.905293 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878bfe43d3d74e1f9e78b98228f263c5', 'request_id': 'req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.918782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] The token cache is being invalidate because project 878bfe43d3d74e1f9e78b98228f263c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:36.919188 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.919971 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d5392cd8-9cde-44b0-82f2-50a9a732a3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:36.922309 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1365/2734] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:36 2022] DELETE /identity/v3/projects/878bfe43d3d74e1f9e78b98228f263c5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:36.927134 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:36.927532 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:36.927934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:36.934908 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:36.937509 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbcb7a-c6cc-4b53-8bbd-830952580c9d service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:36.948704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:36.949830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:36.950500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1370/2735] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:37.026777 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1366/2736] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:37.035311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.035609 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.035921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.057933 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:37.059178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:37.073720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1371/2737] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:37.086202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.097015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673c0d-f937-4bc3-a7bd-a8d0c779b9f8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.104877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.105559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.108248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.108647 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.110152 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:37.110680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.112456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.132849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1367/2738] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:37.137699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.154323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c131e6-2b25-403e-8318-5b5c67247130 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.161215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.161215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.161215 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.161559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.162032 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.163967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.188027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:37.196617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1372/2739] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:37 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:37.201104 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.212595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9810b1-5d97-4540-babd-4363baafc407 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.295646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.296542 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.296858 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.297138 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.297839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.299873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.321486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1368/2740] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:37 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:37.325666 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.336478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddeeff-bcd4-4157-8bb7-eb2684725873 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.341109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.341758 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.342044 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.342324 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.343046 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.345335 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.355127 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1373/2741] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:37.358959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.368837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1997fc-343b-485d-ae88-132afd3ab577 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.373417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.374081 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.374361 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.374632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.375372 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.376984 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5202-cf60-427d-aff3-547afa70f470 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.387087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1369/2742] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:37.392392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.402713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09012d-247d-40e9-b888-713f87e0f2ee admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.408146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.409021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.409305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.409582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] PATH_INFO: `/v3/projects/f25d80eaffd84820a9a0f8227e673319/users/246265ad5be541508ca25600c087baeb/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.424075 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25d80eaffd84820a9a0f8227e673319, user_id=246265ad5be541508ca25600c087baeb, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.426740 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.439538 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1374/2743] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:37 2022] PUT /identity/v3/projects/f25d80eaffd84820a9a0f8227e673319/users/246265ad5be541508ca25600c087baeb/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:37.451724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.452071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.452350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.485097 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] MFA Rules not processed for user `246265ad5be541508ca25600c087baeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:37.486317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:37.497724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:37.552237 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1370/2744] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:37.564301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.565988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:37.621434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef555f-6caf-47f4-a184-7b640c0accdc admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.625581 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.626212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.626490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.626763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.634924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.636376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e06e-c40a-4482-81e5-fea928b88add service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.646109 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1375/2745] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:37.664934 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.728080 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd4711-6c8b-4e10-b746-0714c9336e6a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.732711 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.733584 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.733867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.734169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] PATH_INFO: `/v3/users/246265ad5be541508ca25600c087baeb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.735374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=246265ad5be541508ca25600c087baeb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.737323 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.782801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246265ad5be541508ca25600c087baeb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:37.789651 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246265ad5be541508ca25600c087baeb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:37.790386 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246265ad5be541508ca25600c087baeb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:37.791009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246265ad5be541508ca25600c087baeb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:37.797941 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246265ad5be541508ca25600c087baeb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:37.815607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1371/2746] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:37 2022] DELETE /identity/v3/users/246265ad5be541508ca25600c087baeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:37.820406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f963f8-7a53-49a2-925e-362fb66080fe None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.820879 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f963f8-7a53-49a2-925e-362fb66080fe None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.820977 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f963f8-7a53-49a2-925e-362fb66080fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.838304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c9f963f8-7a53-49a2-925e-362fb66080fe None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:37.839518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c9f963f8-7a53-49a2-925e-362fb66080fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:37.898784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1376/2747] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:37.908981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:37.910714 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:37.947054 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:37.971037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577462e-63c1-43c5-8cee-a9f892a2e27d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:37.974764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:37.975407 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:37.975691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:37.976003 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:37.985705 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:37.987122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:37.996675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1372/2748] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:38.204782 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2611-b996-451c-8bef-6022948958be None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.205183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2611-b996-451c-8bef-6022948958be None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.205560 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb2611-b996-451c-8bef-6022948958be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.223125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a7fb2611-b996-451c-8bef-6022948958be None None] MFA Rules not processed for user `3a08577a5f8742e0b6b5c40ce082a441`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:38.224361 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a7fb2611-b996-451c-8bef-6022948958be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.270108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.271676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.285099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1377/2749] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:38.287983 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2a3a-05b8-4d6d-98d5-f02733e5dbd6 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.293371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.294976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.295433 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.295716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] PATH_INFO: `/v3/projects/f25d80eaffd84820a9a0f8227e673319` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.308506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25d80eaffd84820a9a0f8227e673319)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.310452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.378144 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25d80eaffd84820a9a0f8227e673319', 'request_id': 'req-fd780d47-f931-4787-943c-038255ba33eb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:38.389593 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25d80eaffd84820a9a0f8227e673319', 'request_id': 'req-fd780d47-f931-4787-943c-038255ba33eb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:38.396708 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25d80eaffd84820a9a0f8227e673319', 'request_id': 'req-fd780d47-f931-4787-943c-038255ba33eb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:38.410756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] The token cache is being invalidate because project f25d80eaffd84820a9a0f8227e673319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:38.411223 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:38.412082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fd780d47-f931-4787-943c-038255ba33eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:38.414643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1373/2750] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:38 2022] DELETE /identity/v3/projects/f25d80eaffd84820a9a0f8227e673319 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:38.420537 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.421114 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.421617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.447734 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:38.448582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.460161 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:38.526357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1378/2751] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:38.534803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.535094 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.535374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.539726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.541272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.556086 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:38.557287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.566022 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1374/2752] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:38.570621 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.582070 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cd3d3-7b5c-46b1-9ade-9364533f45f1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.588073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.588733 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.589013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.589286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.590015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:38.590318 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.592402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.606808 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1375/2753] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:38.611776 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.613222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aa596-6b60-4ea1-822e-a17eb06a52f5 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.618584 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.619529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.620235 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.620705 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.623578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.626392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72588f53-778d-44cc-a767-53ef5d30a929 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.632938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.633603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.633877 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.634202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.635497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.637436 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.637765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.639730 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.650668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1379/2754] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:21:38.668790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1376/2755] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:38.678348 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.690964 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae47c66-a16a-4f50-a501-064cbb989430 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.750682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.751381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.751647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.751999 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.752645 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.754617 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.774735 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1380/2756] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:38.778842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.789619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a04d6-d7c5-42b5-acfc-e027be3ac852 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.794482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.795151 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.795434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.795709 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.797044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.798681 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.808853 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1377/2757] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:38.813326 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.823409 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d3c7c-5065-41c2-b3cf-65333df48944 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.828218 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.828874 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.829159 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.829436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.830172 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.831752 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59908-1c72-43d4-a31c-02806df7b061 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.842491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1381/2758] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:38.846638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:38.858147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f081a-d1e0-4a57-a6dd-6465b5215c96 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:38.864219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:38.865295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.865650 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.865991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] PATH_INFO: `/v3/projects/cdb6e12b57ee4841b390cb33868c65d6/users/cf80c8c1782b49ad9b0a526bc1039696/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.882146 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb6e12b57ee4841b390cb33868c65d6, user_id=cf80c8c1782b49ad9b0a526bc1039696, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:38.885606 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:38.902200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1378/2759] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:38 2022] PUT /identity/v3/projects/cdb6e12b57ee4841b390cb33868c65d6/users/cf80c8c1782b49ad9b0a526bc1039696/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:38.903983 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66cfc-dc98-41c2-ae89-129c82eb9df6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:38.904272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66cfc-dc98-41c2-ae89-129c82eb9df6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:38.904545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66cfc-dc98-41c2-ae89-129c82eb9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:38.923271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e3c66cfc-dc98-41c2-ae89-129c82eb9df6 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:38.924536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3c66cfc-dc98-41c2-ae89-129c82eb9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:38.958136 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:38.987593 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1382/2760] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:38.997232 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:39.041882 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:39.054460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf57280-45d6-442e-936c-0466db30ac19 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:39.058153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:39.058795 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:39.059083 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:39.059362 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:39.068340 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:39.069779 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:39.079225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1379/2761] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:39.666694 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:39.666987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:39.667314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:39.695807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] MFA Rules not processed for user `cf80c8c1782b49ad9b0a526bc1039696`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:39.697123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:39.769232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1383/2762] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:39.785552 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:39.786937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:39.853994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d833e8a-4861-43a6-8c7d-3c1cae363023 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:39.857664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:39.858299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:39.858580 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:39.858850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:39.867590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:39.869116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:39.878529 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1380/2763] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:40.010814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:40.013676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:40.103463 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caad42-29bb-4f3b-87e8-39cbe66c56f8 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:40.108632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:40.109976 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:40.110265 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:40.110545 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:40.112370 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:40.127608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:40.130122 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2450-8b4b-427a-8d2a-d91e712752dc service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:40.144173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1384/2764] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:41.137569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:41.139039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:41.155432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5526-d878-4241-abde-a4d654538724 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:41.162261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:41.163526 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.164905 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.165602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] PATH_INFO: `/v3/users/22f709712ce74782a79e6c7b50cbafb3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.167767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f709712ce74782a79e6c7b50cbafb3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:41.170498 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:41.228976 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f709712ce74782a79e6c7b50cbafb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.238716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f709712ce74782a79e6c7b50cbafb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.239937 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f709712ce74782a79e6c7b50cbafb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.240724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f709712ce74782a79e6c7b50cbafb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.251604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-6218390d-8be8-4f72-b1f3-b64096daa2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f709712ce74782a79e6c7b50cbafb3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.275879 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1381/2765] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:41 2022] DELETE /identity/v3/users/22f709712ce74782a79e6c7b50cbafb3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:41.280592 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.281652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.282008 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.302996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:41.304739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:41.341215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.341517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.341796 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.360184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] MFA Rules not processed for user `cf80c8c1782b49ad9b0a526bc1039696`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:41.361402 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:41.373282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:41.393470 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1385/2766] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:41.400323 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:41.402845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:41.430249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1382/2767] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:41.473952 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af30a45-d677-4eb1-8be1-0db2b8e76e64 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:41.478014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:41.478870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.479224 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.479620 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.490647 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:41.492237 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:41.503850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1386/2768] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:41.775764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:41.777841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:41.810863 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:41.816419 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82724474-0e83-4891-8bc7-801bf2f8bfb2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:41.822880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:41.824018 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.824476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.824801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] PATH_INFO: `/v3/projects/ac5267e72cf94e76a2d54e106369c916` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.826129 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5267e72cf94e76a2d54e106369c916)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:41.828659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:41.876646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5267e72cf94e76a2d54e106369c916', 'request_id': 'req-ddbadb5c-3434-4378-95e9-3808f208bb09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.885044 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5267e72cf94e76a2d54e106369c916', 'request_id': 'req-ddbadb5c-3434-4378-95e9-3808f208bb09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.893193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5267e72cf94e76a2d54e106369c916', 'request_id': 'req-ddbadb5c-3434-4378-95e9-3808f208bb09'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.904226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] The token cache is being invalidate because project ac5267e72cf94e76a2d54e106369c916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:41.904511 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.905247 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:41.907405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1383/2769] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:41 2022] DELETE /identity/v3/projects/ac5267e72cf94e76a2d54e106369c916 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:41.911504 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:41.921497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3db0-2037-43cb-b868-29b7110a150f service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:41.982513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:41.983384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:41.983662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:41.983996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] PATH_INFO: `/v3/users/235ef2d09d1c4d458414049de4b5061c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:41.985192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235ef2d09d1c4d458414049de4b5061c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:41.987083 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:42.039924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235ef2d09d1c4d458414049de4b5061c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.049064 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235ef2d09d1c4d458414049de4b5061c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.049675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235ef2d09d1c4d458414049de4b5061c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.057019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235ef2d09d1c4d458414049de4b5061c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.070776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-90920bdd-ad66-4372-b518-c25934cec7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235ef2d09d1c4d458414049de4b5061c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.082069 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1387/2770] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:41 2022] DELETE /identity/v3/users/235ef2d09d1c4d458414049de4b5061c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:21:42.655371 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:42.657171 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:42.671225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbadb5c-3434-4378-95e9-3808f208bb09 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:42.751201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:42.752534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:42.753082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:42.753573 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] PATH_INFO: `/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:42.755043 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea8052a4924ff1b0eff753144bd3ae)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:42.757238 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:42.813743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea8052a4924ff1b0eff753144bd3ae', 'request_id': 'req-53e3833b-57af-4f4f-a141-2a13998a0239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.822417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea8052a4924ff1b0eff753144bd3ae', 'request_id': 'req-53e3833b-57af-4f4f-a141-2a13998a0239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.829296 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea8052a4924ff1b0eff753144bd3ae', 'request_id': 'req-53e3833b-57af-4f4f-a141-2a13998a0239'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.842919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] The token cache is being invalidate because project e3ea8052a4924ff1b0eff753144bd3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:42.843221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.844474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-53e3833b-57af-4f4f-a141-2a13998a0239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:42.846317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1384/2771] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:42 2022] DELETE /identity/v3/projects/e3ea8052a4924ff1b0eff753144bd3ae => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:42.851000 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:42.851506 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:42.851605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:42.871882 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:42.873115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:42.886442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:42.941359 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1388/2772] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:42.949332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:42.949700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:42.950079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:42.969752 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:42.971105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:42.980108 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1385/2773] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:42.985733 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:42.995774 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65a2ce-9c35-4f04-b581-63c97696f4bb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.000513 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.001196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.001481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.001757 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.002486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:43.003425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.005334 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.018875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1389/2774] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:21:43.022987 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.034737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d91c2-1dc2-4982-95bb-3826fb510dea None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.040587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.041852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.042133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.042409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.043276 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.045225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.054390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:43.077544 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1386/2775] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:43.078801 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.091146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189dacb-f118-42a3-92ef-298c5eeda78b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.147785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.148478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.148756 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.149028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.149702 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.151598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.173651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1390/2776] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:43.177864 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.188297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85588d2b-524f-473a-93ad-ead113ba307c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.194381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.195319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.195602 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.195906 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.196635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.198212 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.210088 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1387/2777] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:43.214102 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.225473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc24418-e728-4da9-9cf9-a2824ca7dfc5 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.230368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.231034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.231321 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.231596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.232356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.233956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ae249-875c-46dd-94c5-e24b6becdb1a admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.245768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1391/2778] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:43.250087 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.260620 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15a748-d93a-4a3b-af96-798e365501ef admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.269702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.270745 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.271195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.271596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] PATH_INFO: `/v3/projects/232576f10a384b59b4a1b49531705952/users/1fb9ce85255e4a04bd1fa384f30bb1f2/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.289060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232576f10a384b59b4a1b49531705952, user_id=1fb9ce85255e4a04bd1fa384f30bb1f2, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.291880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.306625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1388/2779] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:43 2022] PUT /identity/v3/projects/232576f10a384b59b4a1b49531705952/users/1fb9ce85255e4a04bd1fa384f30bb1f2/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:43.317203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.317436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.317714 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.348833 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] MFA Rules not processed for user `1fb9ce85255e4a04bd1fa384f30bb1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:43.350346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:43.430944 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1392/2780] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:43.435919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.528029 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb24b5-a4e3-4ee1-955b-27aed19ffdf9 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.534572 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.535241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.535523 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.535799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.536531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.538431 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.566277 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1389/2781] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:43.569932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.581414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c988e60-3a28-4c2e-adca-df1d79936732 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.590942 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:43.643414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.644124 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.644412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.644687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.645414 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.647360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.669686 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1393/2782] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:43.673981 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.688423 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf526e4-3a7e-4b8d-aa83-cbc37122f71d admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.693116 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.693781 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.694071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.694351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.695078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.696712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.708710 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1390/2783] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 16:21:43.712676 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.722914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c8fa-43bd-44b0-8f3c-d29cab137359 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.727692 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.728687 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.729010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.729492 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] PATH_INFO: `/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276/users/20ba2326ce5e441898e4f36838404814/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.746849 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96cc73f042e4251ab8c7c49a4fdb276, user_id=20ba2326ce5e441898e4f36838404814, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.750104 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.762875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1394/2784] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:43 2022] PUT /identity/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276/users/20ba2326ce5e441898e4f36838404814/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:43.767959 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.779894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b63-487c-4b8b-b126-a739ea3725c8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.844576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.845266 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.845555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.845835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.846564 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.848219 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5782dff-feee-4ca4-9dc5-6e205988f1f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.860355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1391/2785] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:43.864760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:43.875748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84561-cc73-4105-9cbc-ce00c208b9f3 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:43.880491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:43.881378 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.881659 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.881937 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] PATH_INFO: `/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276/users/20ba2326ce5e441898e4f36838404814/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.883956 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96cc73f042e4251ab8c7c49a4fdb276, user_id=20ba2326ce5e441898e4f36838404814, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:43.886604 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:43.899858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1395/2786] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:43 2022] PUT /identity/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276/users/20ba2326ce5e441898e4f36838404814/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:43.911331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:43.911619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:43.911996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:43.941792 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] MFA Rules not processed for user `20ba2326ce5e441898e4f36838404814`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:43.943001 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:43.957042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:44.016105 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1392/2787] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:44.027473 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:44.029329 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:44.099518 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd875dc-2041-44e7-82e2-58332f83e905 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:44.103559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:44.103844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:44.104134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:44.104688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:44.114919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:44.116445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:44.127079 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1396/2788] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:44.211596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:44.221225 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f655e-468e-48d6-96f9-f9b1c31dd1c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:44.224880 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:44.225517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:44.225799 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:44.226075 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:44.283989 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:44.285422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ef234-562b-4e95-b618-85e1cf042cf9 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:44.294489 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1393/2789] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:49.061405 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:49.129981 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5882fa-0d00-4811-9f48-f904ec8ecdbc service cinder] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:49.134596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:49.135486 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:49.135776 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:49.136118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] PATH_INFO: `/v3/users/1fb9ce85255e4a04bd1fa384f30bb1f2` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:49.137310 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb9ce85255e4a04bd1fa384f30bb1f2)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:49.139481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:49.150607 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:49.188062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb9ce85255e4a04bd1fa384f30bb1f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.195169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb9ce85255e4a04bd1fa384f30bb1f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.195787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb9ce85255e4a04bd1fa384f30bb1f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.202729 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb9ce85255e4a04bd1fa384f30bb1f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.214979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb9ce85255e4a04bd1fa384f30bb1f2'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.221175 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1397/2790] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:49 2022] DELETE /identity/v3/users/1fb9ce85255e4a04bd1fa384f30bb1f2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:49.225597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:49.226076 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:49.226181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:49.243287 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:49.244519 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:49.305145 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1394/2791] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:49.315528 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:49.316975 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:49.374618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7499b3-094f-4381-95f6-834fe553a4b4 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:49.378813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:49.379461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:49.379751 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:49.380081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:49.389886 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:49.391352 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:49.401086 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1398/2792] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:49.668272 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:49.669744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:49.682487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e54b-377e-4c70-a91b-99abf73e80ee None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:49.687874 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:49.688757 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:49.689046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:49.689324 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] PATH_INFO: `/v3/projects/232576f10a384b59b4a1b49531705952` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:49.690547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232576f10a384b59b4a1b49531705952)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:49.692506 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:49.739683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:49.743852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232576f10a384b59b4a1b49531705952', 'request_id': 'req-32896c7d-1dfc-4db4-870c-7ee91245ff29'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.751147 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232576f10a384b59b4a1b49531705952', 'request_id': 'req-32896c7d-1dfc-4db4-870c-7ee91245ff29'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.757262 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232576f10a384b59b4a1b49531705952', 'request_id': 'req-32896c7d-1dfc-4db4-870c-7ee91245ff29'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.767668 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] The token cache is being invalidate because project 232576f10a384b59b4a1b49531705952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:49.767993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.768626 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.770159 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1395/2793] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:49 2022] DELETE /identity/v3/projects/232576f10a384b59b4a1b49531705952 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:49.774112 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:49.784176 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9573-74ce-43e4-a42e-36d1f7ce82bd service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:49.839993 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:49.840858 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:49.841142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:49.841421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] PATH_INFO: `/v3/users/20ba2326ce5e441898e4f36838404814` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:49.842608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ba2326ce5e441898e4f36838404814)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:49.845117 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:49.877417 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:49.891360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ba2326ce5e441898e4f36838404814'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.898960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ba2326ce5e441898e4f36838404814'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.899652 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ba2326ce5e441898e4f36838404814'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.907636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ba2326ce5e441898e4f36838404814'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.919583 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-cbf975ee-4ca7-4abc-b018-b6401ff2d205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ba2326ce5e441898e4f36838404814'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:49.925624 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1399/2794] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:21:49 2022] DELETE /identity/v3/users/20ba2326ce5e441898e4f36838404814 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:50.253855 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.255590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:50.270073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896c7d-1dfc-4db4-870c-7ee91245ff29 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.345295 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.346378 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.346510 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.346744 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] PATH_INFO: `/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.348497 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96cc73f042e4251ab8c7c49a4fdb276)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.350409 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.411775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96cc73f042e4251ab8c7c49a4fdb276', 'request_id': 'req-472afe5b-6cf5-43ff-a912-6cb4a05deec6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:50.425154 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96cc73f042e4251ab8c7c49a4fdb276', 'request_id': 'req-472afe5b-6cf5-43ff-a912-6cb4a05deec6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:50.434046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96cc73f042e4251ab8c7c49a4fdb276', 'request_id': 'req-472afe5b-6cf5-43ff-a912-6cb4a05deec6'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:50.452551 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] The token cache is being invalidate because project c96cc73f042e4251ab8c7c49a4fdb276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:21:50.453623 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:50.454460 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-472afe5b-6cf5-43ff-a912-6cb4a05deec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:21:50.456586 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1396/2795] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:21:50 2022] DELETE /identity/v3/projects/c96cc73f042e4251ab8c7c49a4fdb276 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:50.462511 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.463053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.463053 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.483465 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:50.484894 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:50.566031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1400/2796] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:50.575107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.575107 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.575991 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.601481 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:50.602718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:50.615170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1397/2797] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:50.616778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.628328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef75f97-b893-44d3-821d-924f8f0b1b6d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.633678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.634541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.634737 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.635051 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.635795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:21:50.636514 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.638192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.658525 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1401/2798] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:21:50.662502 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.662654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.664162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:50.675328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f76409-8fde-4444-b445-549a3a372127 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.682753 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.683477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.683895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.684349 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.685203 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.687980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.720813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1402/2799] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:50 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:50.723662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.746630 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:50.774704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c52efd-5f14-41ce-9b6d-aade5adaf979 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.804018 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfb979-2b19-4a7c-9e23-5c58e563303f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.808763 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.809429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.809710 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.809984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.810660 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.813193 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.839997 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1403/2800] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:50 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:50.841199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.849006 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:50.853174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f136-6894-4da2-8bf5-12f71f90e178 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.860325 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.860657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.861004 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.861310 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.861445 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.861669 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.861803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.861967 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.862704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.863704 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:50.864713 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.875681 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1404/2801] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:50.876822 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.878575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.880392 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.892304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38e75-4301-4bf8-a221-1b25e300124f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.893143 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1398/2802] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:50.899128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.899567 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.899875 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.900160 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.900895 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.902773 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485688d-15a9-4739-ae08-c19f084ac056 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.917767 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1405/2803] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:50.922064 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:50.933016 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e667cef-9a93-4113-8f8d-2d017b10cf1d service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:50.937720 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:50.938627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.938912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.939193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] PATH_INFO: `/v3/projects/4c2dffc5cc2e4f3ab411464d1bc9dcc9/users/1cca5cd358bd4e1d9986b36ea8fb858d/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:50.955335 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2dffc5cc2e4f3ab411464d1bc9dcc9, user_id=1cca5cd358bd4e1d9986b36ea8fb858d, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:50.958073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:50.973268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1399/2804] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:50 2022] PUT /identity/v3/projects/4c2dffc5cc2e4f3ab411464d1bc9dcc9/users/1cca5cd358bd4e1d9986b36ea8fb858d/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:50.983657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:50.984021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:50.984311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.011057 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] MFA Rules not processed for user `1cca5cd358bd4e1d9986b36ea8fb858d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:51.012346 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:51.086128 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1406/2805] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:21:51.090830 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.164595 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fd03-a7bd-461c-b92c-bdc314187cd4 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.169742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.170576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.171013 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.171725 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.172611 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.174717 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.204894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1400/2806] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:21:51 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:21:51.207982 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.218785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc0eab-fa9c-4e32-8f67-81e14659d30b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.274761 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.275425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.275708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.276016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.276709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.278622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.297846 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1407/2807] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:21:51 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:21:51.301737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.313073 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71805f9-8e89-4c99-82da-db9c5f9406f2 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.317787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.318445 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.318732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.319008 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.319739 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.321454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.334492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1401/2808] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:51.338582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.348440 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90feca-7a20-4362-8c25-a6a72195cb62 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.352987 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.353868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.354139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.354418 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] PATH_INFO: `/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8/users/634d8444c6074a5cb7d06039811e60fb/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.368923 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b1dfe47cf247ea98c125118bd91fe8, user_id=634d8444c6074a5cb7d06039811e60fb, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.371541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.384808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1408/2809] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:51 2022] PUT /identity/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8/users/634d8444c6074a5cb7d06039811e60fb/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:51.388659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.399284 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09676779-42b7-40f3-be4f-3b57b7cfe6f8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.424677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:51.454589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.455181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.455459 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.455732 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.456499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.458060 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ce65f-98de-4e8c-81be-0108e17e96af admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.467724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1402/2810] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:21:51.471817 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.481953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d720-fb51-4ef2-b6ae-74409284d656 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.487013 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.487905 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.488183 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.488455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] PATH_INFO: `/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8/users/634d8444c6074a5cb7d06039811e60fb/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.490381 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b1dfe47cf247ea98c125118bd91fe8, user_id=634d8444c6074a5cb7d06039811e60fb, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.493020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.503384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1409/2811] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:21:51 2022] PUT /identity/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8/users/634d8444c6074a5cb7d06039811e60fb/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:21:51.567604 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.567896 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.568181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.593592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] MFA Rules not processed for user `634d8444c6074a5cb7d06039811e60fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:51.594804 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:51.660852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1403/2812] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:21:51.671304 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:51.673529 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:51.702328 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:21:51.731914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b94ed-ba63-48fc-a8df-6cbdf82f51ec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:51.736105 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:51.736747 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:51.737034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:51.737309 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:51.793945 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:51.795376 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019fa5-7f5a-4059-bb75-bf58665b3050 service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:51.805219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1410/2813] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:57.296894 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:21:57.308355 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e98e9-059a-4ee0-b664-80195dc20bfe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:21:57.311949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:21:57.312609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:57.312890 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:57.313716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:57.323327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:21:57.324800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:21:57.335079 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1404/2814] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:21:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:21:59.589872 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beeb1-bfbd-4a62-89f2-712836d22270 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:21:59.590355 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beeb1-bfbd-4a62-89f2-712836d22270 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:21:59.590467 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beeb1-bfbd-4a62-89f2-712836d22270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:21:59.608447 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a95beeb1-bfbd-4a62-89f2-712836d22270 None None] MFA Rules not processed for user `cf80c8c1782b49ad9b0a526bc1039696`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:21:59.609696 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a95beeb1-bfbd-4a62-89f2-712836d22270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:21:59.668067 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1411/2815] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:02.249487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:02.323197 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bf19-5904-42c7-a3a8-ca956c8c85da service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:02.328009 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:02.329200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:02.329576 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:02.329963 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] PATH_INFO: `/v3/users/1cca5cd358bd4e1d9986b36ea8fb858d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:02.331269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cca5cd358bd4e1d9986b36ea8fb858d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:02.333319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:02.379839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:02.388847 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cca5cd358bd4e1d9986b36ea8fb858d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:02.397924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cca5cd358bd4e1d9986b36ea8fb858d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:02.398680 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cca5cd358bd4e1d9986b36ea8fb858d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:02.399346 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cca5cd358bd4e1d9986b36ea8fb858d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:02.408461 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cca5cd358bd4e1d9986b36ea8fb858d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:02.444562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1405/2816] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:22:02 2022] DELETE /identity/v3/users/1cca5cd358bd4e1d9986b36ea8fb858d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:02.446536 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:02.447485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:02.448058 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:02.470867 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:02.471212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:02.547675 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1412/2817] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:02.558446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:02.560082 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:02.631735 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8132343-99d7-4db2-b050-84b3c21925cd admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:02.635428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:02.636102 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:02.636380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:02.636654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:02.647254 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:02.648741 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:02.658763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1406/2818] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:22:03.107902 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:03.109698 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:03.123551 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa791cef-6280-4553-99a1-e1401036b226 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:03.135177 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:03.136205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:03.136631 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:03.137088 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] PATH_INFO: `/v3/projects/4c2dffc5cc2e4f3ab411464d1bc9dcc9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:03.139564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2dffc5cc2e4f3ab411464d1bc9dcc9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:03.154275 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:03.180921 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:03.207723 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2dffc5cc2e4f3ab411464d1bc9dcc9', 'request_id': 'req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.216784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2dffc5cc2e4f3ab411464d1bc9dcc9', 'request_id': 'req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.224546 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2dffc5cc2e4f3ab411464d1bc9dcc9', 'request_id': 'req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.237754 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] The token cache is being invalidate because project 4c2dffc5cc2e4f3ab411464d1bc9dcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:22:03.238045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.238703 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.240523 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1413/2819] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:22:03 2022] DELETE /identity/v3/projects/4c2dffc5cc2e4f3ab411464d1bc9dcc9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:03.244422 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:03.256181 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732574aa-8d1a-4d94-806f-1c7d402933f1 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:03.317641 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:03.318856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:03.319137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:03.319414 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] PATH_INFO: `/v3/users/634d8444c6074a5cb7d06039811e60fb` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:03.320867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634d8444c6074a5cb7d06039811e60fb)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:03.322819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:03.372766 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634d8444c6074a5cb7d06039811e60fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.381819 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634d8444c6074a5cb7d06039811e60fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.382482 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634d8444c6074a5cb7d06039811e60fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.383115 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634d8444c6074a5cb7d06039811e60fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.388675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:03.391051 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-b31c07ac-d11d-489b-8973-49151d9b4880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634d8444c6074a5cb7d06039811e60fb'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.414270 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1407/2820] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:22:03 2022] DELETE /identity/v3/users/634d8444c6074a5cb7d06039811e60fb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:22:03.700541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:03.702052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:03.718719 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ada9-bd42-47d4-9e7c-03c2291bbbec admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:03.788277 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:03.789219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:03.789503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:03.789870 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] PATH_INFO: `/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:03.791258 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b1dfe47cf247ea98c125118bd91fe8)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:03.793497 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:03.841368 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b1dfe47cf247ea98c125118bd91fe8', 'request_id': 'req-ed351981-9a0e-4195-bf7b-b83b3b038c00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.848897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b1dfe47cf247ea98c125118bd91fe8', 'request_id': 'req-ed351981-9a0e-4195-bf7b-b83b3b038c00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.855287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b1dfe47cf247ea98c125118bd91fe8', 'request_id': 'req-ed351981-9a0e-4195-bf7b-b83b3b038c00'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.867254 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] The token cache is being invalidate because project b0b1dfe47cf247ea98c125118bd91fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:22:03.867544 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.868207 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-ed351981-9a0e-4195-bf7b-b83b3b038c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:03.869748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1414/2821] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:22:03 2022] DELETE /identity/v3/projects/b0b1dfe47cf247ea98c125118bd91fe8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:03.876821 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:03.877261 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:03.877541 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:03.896638 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:03.897762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:03.957612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1408/2822] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:03.966500 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:03.966785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:03.967062 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:03.985644 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:03.987431 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:03.995252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1415/2823] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:03.999737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.010118 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab080e7-6046-4558-9173-5dd3e1d5e721 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.015085 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.015856 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.016166 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.016432 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.017928 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:22:04.018239 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.019850 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.031517 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1409/2824] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:22:04.036188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.045755 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104b3f-9104-4e9b-8a23-8ed6f9f1fef4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.050493 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.051149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.051433 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.051728 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.052455 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.054366 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.080795 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1416/2825] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:22:04 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:04.085315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.095560 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453f0c7-9976-4be5-b145-5e3f06bca438 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.157434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.158078 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.158376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.158631 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.159305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.161585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.189698 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1410/2826] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:22:04 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:04.190926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.201311 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9bfcb-dece-4532-b2f8-7dec00bccebd admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.206699 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.207354 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.207638 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.207953 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.208683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.210308 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.213291 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:04.223661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1417/2827] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:04.228170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.238283 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00713f-37bb-4226-ad53-47cf01cbd8df admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.242938 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.243590 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.243912 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.244196 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.244927 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.246537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896404e2-4721-4cad-9445-9c6db7b364ec admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.260327 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1411/2828] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:04.264711 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.275163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25db4a-8932-4759-b46e-9e26ae06496f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.280045 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.281074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.281357 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.281632 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] PATH_INFO: `/v3/projects/fd64e1ec58b744229f63cebf95843e37/users/902eaa63bf7347bd96dd10d6d84059b3/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.301076 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd64e1ec58b744229f63cebf95843e37, user_id=902eaa63bf7347bd96dd10d6d84059b3, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.303765 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.317319 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1418/2829] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:22:04 2022] PUT /identity/v3/projects/fd64e1ec58b744229f63cebf95843e37/users/902eaa63bf7347bd96dd10d6d84059b3/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:04.330211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.330463 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.330716 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.358405 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] MFA Rules not processed for user `902eaa63bf7347bd96dd10d6d84059b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:04.359600 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:04.393456 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:04.428211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1412/2830] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:04.440411 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:04.442116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:04.499932 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020166-0c72-4177-bce4-67e5d9a08052 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:04.503571 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:04.504247 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:04.504532 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:04.504837 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:04.513998 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:04.515708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f703d97-e005-42d5-8e3d-008fb71bec9f service cinder] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:04.524741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1419/2831] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:22:07.074499 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:07.148162 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a4490-b25e-4af0-bf91-514766f59c64 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:07.153005 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:07.154099 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.154452 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.154801 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] PATH_INFO: `/v3/users/902eaa63bf7347bd96dd10d6d84059b3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.156117 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902eaa63bf7347bd96dd10d6d84059b3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:07.158676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:07.210636 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902eaa63bf7347bd96dd10d6d84059b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.219540 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902eaa63bf7347bd96dd10d6d84059b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.222615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902eaa63bf7347bd96dd10d6d84059b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.223234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902eaa63bf7347bd96dd10d6d84059b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.231589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902eaa63bf7347bd96dd10d6d84059b3'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.249128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1413/2832] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:22:07 2022] DELETE /identity/v3/users/902eaa63bf7347bd96dd10d6d84059b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:07.253720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.254212 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.254320 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.271653 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:07.272884 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:07.330596 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1420/2833] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:07.340207 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:07.341773 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:07.405306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970e12-ead4-4665-8663-47ff2b4f7121 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:07.408919 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:07.409558 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.409841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.410119 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.417562 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:07.420096 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:07.421832 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc3ba0-8397-4e70-8a5d-b9c91de1ef08 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:07.435312 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1414/2834] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:22:07.701585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:07.703095 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:07.715928 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa51bc-d443-4009-85b9-31e7a9013f89 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:07.722025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:07.722914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.723199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.723478 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] PATH_INFO: `/v3/projects/fd64e1ec58b744229f63cebf95843e37` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.724779 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd64e1ec58b744229f63cebf95843e37)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:07.726864 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:07.776074 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd64e1ec58b744229f63cebf95843e37', 'request_id': 'req-a01e145c-4891-4caa-8d79-ddddd15a420e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.783678 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd64e1ec58b744229f63cebf95843e37', 'request_id': 'req-a01e145c-4891-4caa-8d79-ddddd15a420e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.789823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd64e1ec58b744229f63cebf95843e37', 'request_id': 'req-a01e145c-4891-4caa-8d79-ddddd15a420e'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.796785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:07.802021 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] The token cache is being invalidate because project fd64e1ec58b744229f63cebf95843e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:22:07.802396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.803394 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a01e145c-4891-4caa-8d79-ddddd15a420e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:07.805622 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1421/2835] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:22:07 2022] DELETE /identity/v3/projects/fd64e1ec58b744229f63cebf95843e37 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:07.810917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.811211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.811493 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.828677 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:07.830488 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:07.888454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1415/2836] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:07.897087 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.897377 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.897657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.918162 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:07.919369 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:07.927909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1422/2837] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:07.932306 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:07.942469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee910f-9645-4e36-b5b9-1cc006b55125 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:07.947215 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:07.947909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.948195 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.948484 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.949331 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:22:07.949656 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:07.951273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:07.963767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1416/2838] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 16:22:07.968070 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:07.977248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ba8c-bdd2-4888-8a24-75a1c10fa111 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:07.981907 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:07.982549 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:07.982829 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:07.983101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:07.983780 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:07.986285 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.014813 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1423/2839] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:08.015873 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:08.026406 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048f83d-3311-466b-86d9-ab8f89b92b22 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:08.086163 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:08.086920 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.087201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.087476 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.088202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:08.090098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.111037 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1417/2840] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:22:08 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:08.115073 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:08.125201 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2dd8-f1cb-4d0c-b0a4-4530b13153ff admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:08.129812 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:08.130460 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.130750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.131028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.131750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:08.133429 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.144708 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1424/2841] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:08.148763 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:08.159250 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de115f69-8479-436a-a479-9da7a0a58135 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:08.163909 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:08.164555 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.164839 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.165114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.165836 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:08.167404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd384a5-d581-40d0-8da7-efba123e72a2 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.177241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1418/2842] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:08.181149 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:08.191459 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa404953-8775-4ba3-bc24-86611fcdf2a0 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:08.196082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:08.196949 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.197282 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.197503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] PATH_INFO: `/v3/projects/4f643c76310b494cad1dbe8400b50e49/users/55e6d79984cf458fa07e9997bbb9a6cb/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.212396 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f643c76310b494cad1dbe8400b50e49, user_id=55e6d79984cf458fa07e9997bbb9a6cb, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:08.215023 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.227661 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1425/2843] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:22:08 2022] PUT /identity/v3/projects/4f643c76310b494cad1dbe8400b50e49/users/55e6d79984cf458fa07e9997bbb9a6cb/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:08.232893 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80166cf-2f95-4b20-80fb-e8e4c883346a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.233186 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80166cf-2f95-4b20-80fb-e8e4c883346a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.233469 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80166cf-2f95-4b20-80fb-e8e4c883346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.251679 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b80166cf-2f95-4b20-80fb-e8e4c883346a None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:08.252955 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b80166cf-2f95-4b20-80fb-e8e4c883346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:08.313440 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1419/2844] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:08.323641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:08.325512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:08.396640 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37686c6f-f9f5-4bba-8e9c-7116b0ac29ce admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:08.402134 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:08.403010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:08.403299 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:08.403579 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:08.418101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:08.419878 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:08.431807 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1426/2845] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 16:22:12.672249 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:12.672803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:12.672803 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:12.680235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:12.704319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] MFA Rules not processed for user `55e6d79984cf458fa07e9997bbb9a6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:12.705609 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:12.784524 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1420/2846] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:12.788920 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:12.799317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35d1f-82d4-403e-9252-17688038271d service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:12.804082 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:12.804736 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:12.805011 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:12.805363 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:12.806056 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:12.807960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:12.836603 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1427/2847] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:22:12 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 16:22:12.840724 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:12.852303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0fb67-b214-4623-ad78-03face4107f7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:12.908932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:12.909588 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:12.909866 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:12.910132 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:12.910816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:12.912734 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:12.932376 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1421/2848] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:22:12 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:12.936636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:12.947479 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffd2c1-c1c1-4a31-ba51-da6bd7da104d admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:12.952295 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:12.953118 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:12.953436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:12.953915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:12.955490 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:12.957569 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:12.970599 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1428/2849] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:12.975317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:12.986198 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafefeec-1cdd-4ecd-8298-05e525ffbd6a admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:12.990975 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:12.991929 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:12.992218 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:12.992492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] PATH_INFO: `/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22/users/8324e6986f5c433091963fd355f3b56c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:13.008077 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45fc8c8b34d4687a274caafd0d4fb22, user_id=8324e6986f5c433091963fd355f3b56c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:13.010646 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:13.024761 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1422/2850] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:22:12 2022] PUT /identity/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22/users/8324e6986f5c433091963fd355f3b56c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:22:13.028988 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:13.039896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e8665-7fe2-4d12-a208-a101e8c0e6e7 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:13.103919 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:13.104591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:13.104866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:13.105139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:13.105863 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:13.107450 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c2669-c32e-404f-b8f4-aa92c083d6f4 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:13.117960 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1429/2851] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:13.122202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:13.132946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756f9f-220b-45be-85d9-9bbe8d4e56ba admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:13.137597 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:13.138466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:13.138742 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:13.139012 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] PATH_INFO: `/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22/users/8324e6986f5c433091963fd355f3b56c/roles/282d17c301bf4bbaacf2239857ad1e7e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:13.141319 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45fc8c8b34d4687a274caafd0d4fb22, user_id=8324e6986f5c433091963fd355f3b56c, role_id=282d17c301bf4bbaacf2239857ad1e7e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:13.144041 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:13.156264 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1423/2852] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:22:13 2022] PUT /identity/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22/users/8324e6986f5c433091963fd355f3b56c/roles/282d17c301bf4bbaacf2239857ad1e7e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:18.260749 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656f63-8d43-4895-ab54-cf0bf8f5728f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:18.261287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656f63-8d43-4895-ab54-cf0bf8f5728f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:18.261287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656f63-8d43-4895-ab54-cf0bf8f5728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:18.267496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:18.295912 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0c656f63-8d43-4895-ab54-cf0bf8f5728f None None] MFA Rules not processed for user `8324e6986f5c433091963fd355f3b56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:18.297400 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0c656f63-8d43-4895-ab54-cf0bf8f5728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:18.370016 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1430/2853] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:18.385612 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:18.387230 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:18.437446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:18.470715 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd8509-8db1-4f0e-9355-3e1508f99e8e admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:18.476534 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:18.477200 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:18.477486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:18.477771 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:18.537256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:18.538837 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece0a02-94a7-4b10-9d38-bff5b6a7f777 service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:18.548615 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1424/2854] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:22:19.520025 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:19.520491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:19.520621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:19.543682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] MFA Rules not processed for user `55e6d79984cf458fa07e9997bbb9a6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:19.545034 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:19.553033 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1431/2855] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:22:23.880737 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6fb0c-6385-484e-99e9-6fcd0d3e9674 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:23.881192 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6fb0c-6385-484e-99e9-6fcd0d3e9674 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:23.881444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6fb0c-6385-484e-99e9-6fcd0d3e9674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:23.900184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d0a6fb0c-6385-484e-99e9-6fcd0d3e9674 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:23.901397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d0a6fb0c-6385-484e-99e9-6fcd0d3e9674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:23.961466 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1425/2856] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Jun 29 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:24.009365 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:24.010793 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:24.087778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de4d8-0034-4cb8-927b-3d7b8e90e7b2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:24.093199 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:24.093885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:24.094168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:24.094442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:24.103422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:24.105142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:24.114115 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1432/2857] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:22:33.952235 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=61 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:34.109827 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=68 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:46.946492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:46.946965 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:46.947184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:46.981607 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] MFA Rules not processed for user `22d4d07cc700460f8898c69d66268e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:46.982816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:47.008699 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1426/2858] 10.222.0.47 () {58 vars in 967 bytes} [Wed Jun 29 16:22:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:47.021494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:47.062119 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c97fb-8d04-4b03-8979-523ce0af9e1a service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:47.067196 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da042356bb0f4417a8f2ace132cb9028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:47.067844 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:47.068144 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:47.068423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:47.076386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:47.077969 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:47.087039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1433/2859] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Jun 29 16:22:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 16:22:55.240993 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:55.242430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:55.292915 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:55.294811 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:55.321685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a69f-8b8c-403e-a6cf-9bc66aa1c529 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:55.326706 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:55.327352 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:55.327632 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:55.327946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:55.329694 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:55.341364 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:55.342986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:55.353241 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1427/2860] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:22:55.395356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac7c1c-b5c5-49a3-87be-8660ceea854b service swift] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:55.400042 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:55.400909 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:55.401190 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:55.401462 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] PATH_INFO: `/v3/users/cf80c8c1782b49ad9b0a526bc1039696` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:55.402662 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf80c8c1782b49ad9b0a526bc1039696)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:55.404618 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:55.451739 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf80c8c1782b49ad9b0a526bc1039696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.460028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf80c8c1782b49ad9b0a526bc1039696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.460717 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf80c8c1782b49ad9b0a526bc1039696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.468099 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf80c8c1782b49ad9b0a526bc1039696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.480557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13e4e95a-d627-46a7-8a40-3e7e73e9f745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf80c8c1782b49ad9b0a526bc1039696'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.486871 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1434/2861] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:22:55 2022] DELETE /identity/v3/users/cf80c8c1782b49ad9b0a526bc1039696 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:22:55.661635 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:55.678344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33feb2-8872-42c8-b525-c55e37e88fb8 service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:55.753759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:55.754640 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:55.754917 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:55.755193 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] PATH_INFO: `/v3/projects/cdb6e12b57ee4841b390cb33868c65d6` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:55.756404 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb6e12b57ee4841b390cb33868c65d6)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:55.758279 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:55.807800 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb6e12b57ee4841b390cb33868c65d6', 'request_id': 'req-4ffcd230-e840-4505-9382-919f815d47d1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.817684 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb6e12b57ee4841b390cb33868c65d6', 'request_id': 'req-4ffcd230-e840-4505-9382-919f815d47d1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.819184 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:55.827258 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb6e12b57ee4841b390cb33868c65d6', 'request_id': 'req-4ffcd230-e840-4505-9382-919f815d47d1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.838337 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] The token cache is being invalidate because project cdb6e12b57ee4841b390cb33868c65d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:22:55.838625 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.839268 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-4ffcd230-e840-4505-9382-919f815d47d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:22:55.840842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1428/2862] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:22:55 2022] DELETE /identity/v3/projects/cdb6e12b57ee4841b390cb33868c65d6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:55.845778 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:55.846068 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:55.846344 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:55.855002 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:55.903958 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:55.905101 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:55.965841 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1435/2863] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:22:55.974458 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:55.974743 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:55.975020 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:55.995305 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:55.996718 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:56.005297 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1429/2864] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:22:56.009496 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.019794 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047eb23-1c7e-4a03-8d03-cf8b51c2255c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.025415 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.026077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.026362 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.026641 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.027372 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 16:22:56.027683 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.029318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.041271 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1436/2865] 10.222.0.47 () {58 vars in 1152 bytes} [Wed Jun 29 16:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 16:22:56.045652 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.055298 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269d796-de28-41f2-aa2b-930c98e8e4fc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.059923 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.060557 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.060835 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.061103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.061790 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.063691 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.091538 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1430/2866] 10.222.0.47 () {60 vars in 1152 bytes} [Wed Jun 29 16:22:56 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:56.095668 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.105766 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256307d-b22f-4045-b74d-801d9d924744 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.161985 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.162582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.162868 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.163148 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.163850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.165762 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.185432 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1437/2867] 10.222.0.47 () {60 vars in 1143 bytes} [Wed Jun 29 16:22:56 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 16:22:56.190782 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.201214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f76b3-421e-4cc6-9db4-a864b429297c admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.205986 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.206643 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.206926 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.207202 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.207960 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.209553 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.220367 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1431/2868] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:56.224706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.234436 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e55037-dcce-4cf6-ada5-11524830ec29 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.239924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.240574 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.240853 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.241125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.241845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.243423 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7f353-5182-4b1a-a985-e5aa6e7fb7f5 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.253142 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1438/2869] 10.222.0.47 () {58 vars in 1121 bytes} [Wed Jun 29 16:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 16:22:56.257065 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.267236 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029828c-42f4-4050-9aa8-6189132cba12 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.271892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.272767 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.273046 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.273317 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] PATH_INFO: `/v3/projects/f918504272d341b8b9681e2dce016ae3/users/2e981f9585694bbab5c8563ad1450e6d/roles/b99720dc499444929a34d318a2d6c494` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.288039 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f918504272d341b8b9681e2dce016ae3, user_id=2e981f9585694bbab5c8563ad1450e6d, role_id=b99720dc499444929a34d318a2d6c494)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.290661 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.303579 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1432/2870] 10.222.0.47 () {60 vars in 1482 bytes} [Wed Jun 29 16:22:56 2022] PUT /identity/v3/projects/f918504272d341b8b9681e2dce016ae3/users/2e981f9585694bbab5c8563ad1450e6d/roles/b99720dc499444929a34d318a2d6c494 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:22:56.313356 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.313847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.313984 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.340010 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] MFA Rules not processed for user `2e981f9585694bbab5c8563ad1450e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:22:56.341222 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:56.371485 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:22:56.405847 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1439/2871] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:22:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 16:22:56.417666 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:22:56.419342 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:22:56.475585 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f269ad-8590-4473-8f35-b94b0efe78b7 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:22:56.479221 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3d302dfefab4d4a9cad2b67c3c70268', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:22:56.479881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:22:56.480167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:22:56.480442 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:22:56.489265 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:22:56.490664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5baf-b33d-4295-8583-63f3b36246e0 service glance] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:22:56.499381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1433/2872] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:22:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:23:02.017591 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:02.019564 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:02.113943 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ea23-b207-49bc-a7da-9a4cd0a5738f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:02.119081 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:02.119726 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:02.120110 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:02.120421 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:02.122232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:02.134422 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:02.136027 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:02.147722 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1440/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:23:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:23:06.495420 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=58,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:12.142307 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=54 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:19.953954 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:19.954411 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:19.954509 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:19.971693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] MFA Rules not processed for user `3a08577a5f8742e0b6b5c40ce082a441`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:23:19.973516 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:20.028023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1434/2874] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:23:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:23:29.255441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:29.256860 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:29.332515 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc999b7-02c3-48d6-b843-3878d0abe20f service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:29.336570 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:29.337204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:29.337480 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:29.337750 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:29.339494 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:29.399814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:29.401262 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826886c-91da-4111-95b9-cd30cc1351c5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:29.410534 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1441/2875] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:23:30.021687 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=25 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:37.808817 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:37.869023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e174c-afe1-4583-aeae-b1c730deffdd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:37.873454 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:37.874397 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:37.874678 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:37.874944 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] PATH_INFO: `/v3/users/2e981f9585694bbab5c8563ad1450e6d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:37.876133 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e981f9585694bbab5c8563ad1450e6d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:37.878019 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:37.924521 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e981f9585694bbab5c8563ad1450e6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:37.932294 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e981f9585694bbab5c8563ad1450e6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:37.932996 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e981f9585694bbab5c8563ad1450e6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:37.933592 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e981f9585694bbab5c8563ad1450e6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:37.940330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e981f9585694bbab5c8563ad1450e6d'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:37.957654 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1435/2876] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:23:37 2022] DELETE /identity/v3/users/2e981f9585694bbab5c8563ad1450e6d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:23:37.962227 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:37.962704 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:37.962815 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:37.979688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] MFA Rules not processed for user `06ea7f03390747a9846b3824e80fc6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:23:37.980922 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:38.040787 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1442/2877] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:23:38.050425 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:38.052417 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:38.109967 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ca0b-88d9-4d4e-b46c-1691b3f91abe admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:38.113583 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:38.114812 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:38.115089 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:38.115360 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:38.124190 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:38.125603 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:38.134807 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1436/2878] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:23:38.400116 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:38.401548 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:38.414397 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d81-0d2e-4755-99ec-a2c2446b7d11 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:38.418963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:38.419881 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:38.420170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:38.420442 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] PATH_INFO: `/v3/projects/f918504272d341b8b9681e2dce016ae3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:38.421615 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f918504272d341b8b9681e2dce016ae3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:38.423636 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:38.460557 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:38.477903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f918504272d341b8b9681e2dce016ae3', 'request_id': 'req-fc5e2839-389a-42c3-95c6-bf7193043da1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:38.484697 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f918504272d341b8b9681e2dce016ae3', 'request_id': 'req-fc5e2839-389a-42c3-95c6-bf7193043da1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:38.490741 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f918504272d341b8b9681e2dce016ae3', 'request_id': 'req-fc5e2839-389a-42c3-95c6-bf7193043da1'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:38.500682 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] The token cache is being invalidate because project f918504272d341b8b9681e2dce016ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:23:38.500963 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:38.501582 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-fc5e2839-389a-42c3-95c6-bf7193043da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:23:38.503080 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1443/2879] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:23:38 2022] DELETE /identity/v3/projects/f918504272d341b8b9681e2dce016ae3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:23:48.131177 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:48.497791 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:23:53.408878 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:23:53.410282 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:53.486531 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfcdc-5785-484f-b107-6b371a9d6484 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:23:53.537575 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8402cadd9aac46518a45b01b18ef1965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:23:53.538227 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:23:53.538508 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:23:53.538783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:23:53.540589 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:23:53.598149 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:23:53.599596 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:23:53.608537 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1437/2880] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:24:03.604451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=77 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:06.637526 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:06.638028 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:06.638139 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:06.655425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] MFA Rules not processed for user `da01cd253f6e4bc792868f337ff85b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 16:24:06.656651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:06.663384 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1444/2881] 10.222.0.47 () {58 vars in 957 bytes} [Wed Jun 29 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 16:24:06.980786 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:06.982214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:07.037618 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d55be-ab6e-4b7c-ba2b-383ea4311562 service cinder] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:07.042033 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:07.042670 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:07.042956 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:07.043234 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:07.045169 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:07.055167 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:07.056619 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:07.065021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1438/2882] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:24:16.650805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:17.061059 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=26 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:33.615883 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:33.617430 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:33.629924 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569ca0-c5ad-4185-801b-db587c55147a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:33.633621 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:33.634264 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:33.634547 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:33.634955 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:33.636606 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:33.701760 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:33.703287 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:33.713407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1445/2883] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:24:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:24:35.262303 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:35.263756 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:35.353567 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f712ea-76d3-41cd-a7f6-7d74437013bd service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:35.359702 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:35.360384 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:35.360675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:35.360946 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:35.362826 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:35.375127 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:35.376746 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:35.389170 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1439/2884] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:24:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:24:36.435371 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:36.436885 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:36.498685 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:36.500128 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:36.512910 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64ab1-a88b-4617-a1a5-ca95d23c7e4b service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:36.518917 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:36.519578 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:36.519938 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:36.520219 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:36.522481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:24:36.535898 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:36.537685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:36.548585 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1446/2885] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:24:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:24:36.571528 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c591b-193b-4a30-af49-f0d24a3548fc service nova] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:36.576676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:36.577556 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:36.577842 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:36.578122 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] PATH_INFO: `/v3/users/3a08577a5f8742e0b6b5c40ce082a441` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:36.579322 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a08577a5f8742e0b6b5c40ce082a441)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:36.581269 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:36.628025 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a08577a5f8742e0b6b5c40ce082a441'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.634972 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a08577a5f8742e0b6b5c40ce082a441'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.635571 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a08577a5f8742e0b6b5c40ce082a441'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.636211 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a08577a5f8742e0b6b5c40ce082a441'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.643273 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a08577a5f8742e0b6b5c40ce082a441'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.655574 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:36.660969 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1440/2886] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:24:36 2022] DELETE /identity/v3/users/3a08577a5f8742e0b6b5c40ce082a441 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:24:36.828461 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:24:36.841476 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb81be-f1c2-4d81-bae5-8e55b306086d service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:24:36.898163 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:24:36.898954 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:24:36.899238 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:24:36.899512 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] PATH_INFO: `/v3/projects/15a3c06b3b2d44d18cbc5dd1ed2b4b92` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:24:36.900764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a3c06b3b2d44d18cbc5dd1ed2b4b92)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:24:36.903204 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:24:36.935048 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:36.952019 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'request_id': 'req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.959178 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'request_id': 'req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.966170 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a3c06b3b2d44d18cbc5dd1ed2b4b92', 'request_id': 'req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.977464 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] The token cache is being invalidate because project 15a3c06b3b2d44d18cbc5dd1ed2b4b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80241) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:24:36.977850 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.978625 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:24:36.981168 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1447/2887] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:24:36 2022] DELETE /identity/v3/projects/15a3c06b3b2d44d18cbc5dd1ed2b4b92 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:24:46.665703 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:24:46.973360 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:23.838267 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:23.839783 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:23.897924 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b29f9-4299-41c6-b614-ba546ac4e8e8 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:23.944676 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:23.945243 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:23.945522 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:23.945794 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:23.947566 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:24.029330 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:24.031430 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:24.052444 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1441/2888] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:25.231108 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:25.232491 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:25.244897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f81-961a-4c3b-b43b-e75a1aa0581c admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:25.248412 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:25.249037 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:25.249318 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:25.249590 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:25.251926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:25.264688 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:25.266358 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:25.277248 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1448/2889] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:34.049697 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=83 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:34.052315 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:34.061042 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea13f7-ffd8-45de-9f84-8c9ad919d95d service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:34.065307 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:34.065936 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:34.066214 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:34.066485 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:34.068286 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:34.078226 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:34.079659 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:34.088308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1442/2890] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:35.272406 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=6 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:38.824205 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:38.826670 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:38.840925 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dc87-a32e-4e8a-b07e-18837cc9fe83 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:38.845970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:38.846927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:38.847435 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:38.847786 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:38.849651 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:38.861256 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:38.862706 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:38.887001 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1449/2891] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:39.021153 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:39.030023 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6daac5-5906-4ae3-8079-1c3f7dcdcada service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:39.034217 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:39.034903 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:39.035178 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:39.035428 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:39.037693 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:39.052447 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:39.054418 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:39.073434 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1443/2892] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:39.270071 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:39.271553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:39.290940 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea60f2-6266-4907-a038-413dfeec3644 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:39.297272 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34be797ec47b4d66aba7a9fa13419dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:39.298030 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:39.298343 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:39.298685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:39.300866 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:39.314458 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:39.316077 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:39.327814 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1450/2893] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:47.941512 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:47.950179 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684295-ecc2-4401-b273-524a77febdec service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:47.953852 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:47.954474 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:47.954754 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:47.955028 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:47.956867 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:48.018350 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:48.019762 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:48.029299 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1444/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:26:49.322888 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=12 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:54.646232 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:54.647709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:54.663174 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9440d-10a1-4f0f-bde0-de9a776fca29 service nova] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:54.667893 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:54.668764 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:54.669043 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:54.669317 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] PATH_INFO: `/v3/users/da01cd253f6e4bc792868f337ff85b0a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:54.670481 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da01cd253f6e4bc792868f337ff85b0a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:54.672980 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:54.718314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da01cd253f6e4bc792868f337ff85b0a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:54.725347 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da01cd253f6e4bc792868f337ff85b0a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:54.725970 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da01cd253f6e4bc792868f337ff85b0a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:54.732845 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da01cd253f6e4bc792868f337ff85b0a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:54.744979 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da01cd253f6e4bc792868f337ff85b0a'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:54.750745 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1451/2895] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:26:54 2022] DELETE /identity/v3/users/da01cd253f6e4bc792868f337ff85b0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:26:54.922953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:54.933547 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a60d1-a7d9-4ca2-9e70-5b2ce833aea2 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:54.989953 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:54.990816 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:54.991103 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:54.991380 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] PATH_INFO: `/v3/projects/8c561382be984c2b9c1285c6e5b6268a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:54.992587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c561382be984c2b9c1285c6e5b6268a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:54.994505 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:55.039683 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c561382be984c2b9c1285c6e5b6268a', 'request_id': 'req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.046674 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c561382be984c2b9c1285c6e5b6268a', 'request_id': 'req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.052932 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c561382be984c2b9c1285c6e5b6268a', 'request_id': 'req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.059066 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:55.063885 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] The token cache is being invalidate because project 8c561382be984c2b9c1285c6e5b6268a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:26:55.064248 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.065114 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.067124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1445/2896] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:26:54 2022] DELETE /identity/v3/projects/8c561382be984c2b9c1285c6e5b6268a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:26:55.071269 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:55.072709 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:55.086720 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5709f-e702-4374-a082-433bb14dc255 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:55.142768 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:55.143637 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:55.144020 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:55.144301 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] PATH_INFO: `/v3/users/b474c7eaab2749a4a364fea9c6fb4ef9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:55.145489 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b474c7eaab2749a4a364fea9c6fb4ef9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:55.147386 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:55.191657 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b474c7eaab2749a4a364fea9c6fb4ef9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.198748 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b474c7eaab2749a4a364fea9c6fb4ef9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.199364 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b474c7eaab2749a4a364fea9c6fb4ef9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.206903 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b474c7eaab2749a4a364fea9c6fb4ef9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.214420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:26:55.220014 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b474c7eaab2749a4a364fea9c6fb4ef9'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.226672 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1452/2897] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:26:55 2022] DELETE /identity/v3/users/b474c7eaab2749a4a364fea9c6fb4ef9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 16:26:55.397388 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:26:55.399071 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:26:55.422451 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9287-a257-40c0-bab1-c352d1ba1b3b admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:26:55.483949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:26:55.485390 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:26:55.485675 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:26:55.485950 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] PATH_INFO: `/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:26:55.487174 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f7a2e88c03444bb0c91b0b98c1d863)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:26:55.489892 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:26:55.536787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f7a2e88c03444bb0c91b0b98c1d863', 'request_id': 'req-323050ba-b822-495f-9a39-ebc99fae18c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.543849 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f7a2e88c03444bb0c91b0b98c1d863', 'request_id': 'req-323050ba-b822-495f-9a39-ebc99fae18c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.550520 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f7a2e88c03444bb0c91b0b98c1d863', 'request_id': 'req-323050ba-b822-495f-9a39-ebc99fae18c1'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.560664 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] The token cache is being invalidate because project 93f7a2e88c03444bb0c91b0b98c1d863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:26:55.560948 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.561559 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:26:55.563137 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1446/2898] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:26:55 2022] DELETE /identity/v3/projects/93f7a2e88c03444bb0c91b0b98c1d863 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:27:05.225897 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:27:05.557700 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:02.040192 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:02.041820 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:02.115797 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79bf-59b2-4184-8805-09f0336ddd6b admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:02.173314 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:02.173959 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:02.174241 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:02.175125 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:02.176926 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:02.187873 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:02.189441 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:02.199598 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1453/2899] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:28:12.195188 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=58 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:22.722759 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:22.724201 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:22.780487 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323050ba-b822-495f-9a39-ebc99fae18c1 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:22.784787 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:22.785424 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:22.785712 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:22.785994 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:22.787780 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:22.844569 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:22.845995 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:22.855377 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1447/2900] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:28:27.525173 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:27.526784 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:27.538401 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617e600-9bcb-45a3-8ea6-73a5b7e85edb service placement] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:27.542039 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '076ef080a9444bea928197a18d546cb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:27.542785 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:27.543089 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:27.543395 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:27.545181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:27.607667 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:27.609052 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:27.618541 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1454/2901] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:28:30.647464 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:30.649308 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:30.665021 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159757-02d3-444f-98df-3a832c02eef9 service neutron] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:30.670084 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:30.670881 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:30.671173 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:30.671446 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:30.673587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:30.685911 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:30.687722 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:30.704015 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1448/2902] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:28:33.811305 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:33.812808 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:33.826407 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6fba2-1d2f-4079-b6f6-8ba7eac372c5 service neutron] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:33.831927 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:33.832862 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:33.833146 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:33.833420 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] PATH_INFO: `/v3/users/55e6d79984cf458fa07e9997bbb9a6cb` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:33.834608 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e6d79984cf458fa07e9997bbb9a6cb)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:33.836595 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:33.882059 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e6d79984cf458fa07e9997bbb9a6cb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:33.888685 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e6d79984cf458fa07e9997bbb9a6cb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:33.889425 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e6d79984cf458fa07e9997bbb9a6cb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:33.897413 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e6d79984cf458fa07e9997bbb9a6cb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:33.910434 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e6d79984cf458fa07e9997bbb9a6cb'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:33.916374 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1455/2903] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:28:33 2022] DELETE /identity/v3/users/55e6d79984cf458fa07e9997bbb9a6cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:28:34.086256 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:34.098381 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0af8f-19d6-4475-938a-fbe3b75b923c service placement] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:34.155191 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:34.156093 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:34.156374 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:34.156653 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] PATH_INFO: `/v3/projects/4f643c76310b494cad1dbe8400b50e49` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:34.157851 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f643c76310b494cad1dbe8400b50e49)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:34.160351 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:34.202841 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:34.207492 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f643c76310b494cad1dbe8400b50e49', 'request_id': 'req-d4e7417b-486e-46c3-8bda-c02e6364e488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.214622 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f643c76310b494cad1dbe8400b50e49', 'request_id': 'req-d4e7417b-486e-46c3-8bda-c02e6364e488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.220809 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f643c76310b494cad1dbe8400b50e49', 'request_id': 'req-d4e7417b-486e-46c3-8bda-c02e6364e488'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.231791 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] The token cache is being invalidate because project 4f643c76310b494cad1dbe8400b50e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:28:34.232124 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.232775 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.234332 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1449/2904] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:28:34 2022] DELETE /identity/v3/projects/4f643c76310b494cad1dbe8400b50e49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:28:34.238255 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:34.239689 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:34.253169 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ec580-8bce-4789-8d88-1d1febe87262 admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:34.308477 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:34.309274 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:34.309553 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:34.309823 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] PATH_INFO: `/v3/users/8324e6986f5c433091963fd355f3b56c` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:34.311031 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8324e6986f5c433091963fd355f3b56c)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:34.313225 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:34.319123 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:34.359559 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8324e6986f5c433091963fd355f3b56c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.366382 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8324e6986f5c433091963fd355f3b56c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.366990 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8324e6986f5c433091963fd355f3b56c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.373788 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8324e6986f5c433091963fd355f3b56c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.385996 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8324e6986f5c433091963fd355f3b56c'} {{(pid=80241) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.391851 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1456/2905] 10.222.0.47 () {58 vars in 1223 bytes} [Wed Jun 29 16:28:34 2022] DELETE /identity/v3/users/8324e6986f5c433091963fd355f3b56c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:28:34.570608 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:28:34.572150 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:28:34.587391 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7417b-486e-46c3-8bda-c02e6364e488 admin admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:28:34.645486 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ea7f03390747a9846b3824e80fc6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0320d17cc99a4a6e8e5f8fed868d1937', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:28:34.646344 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:28:34.646627 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:28:34.646901 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] PATH_INFO: `/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:28:34.648098 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45fc8c8b34d4687a274caafd0d4fb22)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:28:34.650002 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:28:34.694949 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45fc8c8b34d4687a274caafd0d4fb22', 'request_id': 'req-bb9784e6-fcd3-4947-afe8-05f9e1497538'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.701160 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45fc8c8b34d4687a274caafd0d4fb22', 'request_id': 'req-bb9784e6-fcd3-4947-afe8-05f9e1497538'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.707231 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45fc8c8b34d4687a274caafd0d4fb22', 'request_id': 'req-bb9784e6-fcd3-4947-afe8-05f9e1497538'} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.717483 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] The token cache is being invalidate because project a45fc8c8b34d4687a274caafd0d4fb22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80240) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 16:28:34.717764 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.718392 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [None req-bb9784e6-fcd3-4947-afe8-05f9e1497538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80240) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 16:28:34.719939 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1450/2906] 10.222.0.47 () {58 vars in 1232 bytes} [Wed Jun 29 16:28:34 2022] DELETE /identity/v3/projects/a45fc8c8b34d4687a274caafd0d4fb22 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 16:28:44.388484 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:28:44.714587 dv-cinder-848147-1-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 16:33:04.358503 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 16:33:04.359914 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:33:04.498821 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5c6c5-c3cd-440c-99d3-d8c2e1f5ff1f admin admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 16:33:04.556610 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a279f9aa024490fa421bb6fe5fd0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc81b5cd9db40abac74dbd8cc0c7bff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 16:33:04.557252 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 16:33:04.557533 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 16:33:04.557805 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 16:33:04.559605 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 16:33:04.570588 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 16:33:04.572181 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93829d59-3f66-465e-9153-517776c7eb9f service placement] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 16:33:04.581896 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1457/2907] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Jun 29 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 16:33:14.577654 dv-cinder-848147-1-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=89 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}